-- Logs begin at Tue 2021-11-23 09:36:28 UTC, end at Tue 2021-11-23 10:38:21 UTC. -- Nov 23 10:09:34.829426 dv-cinder-804035-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 10:09:34.838719 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 10:09:34 2021] *** Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: nodename: dv-cinder-804035-15-iscsi Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: machine: x86_64 Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: clock source: unix Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: pcre jit disabled Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: detected number of CPU cores: 4 Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: current working directory: / Nov 23 10:09:34.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: detected binary path: /usr/bin/uwsgi-core Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: your processes number limit is 47680 Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: your memory page size is 4096 bytes Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: detected max file descriptor number: 2048 Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: lock engine: pthread robust mutexes Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: thunder lock: enabled Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 10:09:34.841374 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 10:09:34.884973 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: Python main interpreter initialized at 0x561b237a69c0 Nov 23 10:09:34.884973 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: python threads support enabled Nov 23 10:09:34.884973 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: your server socket listen backlog is limited to 100 connections Nov 23 10:09:34.884973 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: your mercy for graceful operations on workers is 90 seconds Nov 23 10:09:34.885281 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 10:09:34.885385 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: *** Operational MODE: preforking *** Nov 23 10:09:34.885652 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: *** uWSGI is running in multiple interpreter mode *** Nov 23 10:09:34.885652 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: spawned uWSGI master process (pid: 101885) Nov 23 10:09:34.885847 dv-cinder-804035-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 10:09:34.886903 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: spawned uWSGI worker 1 (pid: 101886, cores: 1) Nov 23 10:09:34.886903 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: spawned uWSGI worker 2 (pid: 101887, cores: 1) Nov 23 10:09:34.886903 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 10:09:36.484208 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:09:36.484208 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: from cryptography.utils import int_from_bytes Nov 23 10:09:36.484862 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:09:36.484862 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: from cryptography.utils import int_from_bytes Nov 23 10:09:36.508779 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:09:36.508779 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: from cryptography.utils import int_from_bytes Nov 23 10:09:36.509375 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:09:36.509375 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: from cryptography.utils import int_from_bytes Nov 23 10:09:39.011813 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 10:09:39.012366 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 10:09:39.012545 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 10:09:39.012914 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 10:09:39.013171 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 10:09:39.013558 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.013645 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 10:09:39.014038 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.014119 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 10:09:39.014235 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.014410 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 10:09:39.014557 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.014770 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 10:09:39.014888 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.015025 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 10:09:39.015203 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.015408 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.015528 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.015734 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.015853 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016056 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016188 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016376 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016462 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016705 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.016807 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017021 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017126 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-15-iscsi {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017341 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017426 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017660 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.017823 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018030 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018123 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018291 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018381 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018609 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018701 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.018936 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-15-iscsi {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.019027 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.019258 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.019341 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.019574 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.019764 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020163 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020163 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020390 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020502 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020618 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020788 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.020976 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021085 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021219 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021443 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021583 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021782 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.021919 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022109 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022219 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022423 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022518 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022758 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.022849 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023071 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023162 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023446 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023545 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-15-iscsi {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023765 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.023850 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024085 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024171 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024406 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024498 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024771 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.024864 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025122 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025206 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-15-iscsi {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025435 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025557 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025783 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.025887 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026112 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026201 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026425 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026517 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026767 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.026853 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027094 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027221 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027419 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027526 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027743 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.027838 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028047 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028151 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028374 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028468 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028669 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028768 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.028993 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029098 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029301 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029407 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029609 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029772 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029909 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.029994 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030201 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030302 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030526 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030616 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030840 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.030926 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031151 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031244 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031404 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031495 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031657 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031743 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.031977 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032083 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032301 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032407 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032613 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032707 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032876 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.032959 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.033129 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.033228 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034002 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034097 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034331 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034416 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034644 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034738 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.034956 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035040 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035264 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035349 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035575 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035660 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035885 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.035974 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036194 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036284 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036503 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036586 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036810 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.036901 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037128 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037209 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037447 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037540 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037776 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.037862 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038089 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038181 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038411 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038496 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038727 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.038809 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039049 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039142 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039356 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039446 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039668 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039750 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.039976 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040072 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040286 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040371 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040610 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040694 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.040946 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041038 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041253 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041338 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041506 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041590 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041839 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.041971 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042149 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042234 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042470 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042553 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042779 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.042864 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043088 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043171 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043395 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043484 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043695 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.043793 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044009 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044108 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044316 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044398 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044622 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044705 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.044931 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045040 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045239 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045349 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045547 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045662 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045887 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.045980 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046199 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046292 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046507 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046591 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046829 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.046914 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047153 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047266 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047463 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047549 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047769 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.047853 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.048076 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.048167 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.048386 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.048470 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.048963 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.049087 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.049862 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050035 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050165 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050253 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050494 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050585 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050806 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.050898 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051117 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051213 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051428 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051511 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051734 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.051824 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052047 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052174 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052354 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052444 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052662 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052756 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.052993 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053098 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053278 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053360 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053589 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053674 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.053922 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054005 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054227 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054311 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054532 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054616 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054839 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.054931 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055146 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055235 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055449 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055532 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055754 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.055836 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056053 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056135 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056358 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056441 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056666 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056756 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.056971 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057055 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057278 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057363 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057581 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057663 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.057926 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.058025 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.058250 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.058335 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.058563 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.058647 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.058874 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.058968 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.059184 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.059267 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.059504 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:09:39.059596 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.059845 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.059941 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060166 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060258 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060484 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060568 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060802 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.060897 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061134 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061232 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061450 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061543 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061790 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.061878 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062106 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062193 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062426 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062512 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062748 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.062833 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063060 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063143 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063374 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063458 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063690 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.063776 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064011 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064106 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064326 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064415 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064671 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064764 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.064989 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065079 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065307 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065391 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065618 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065717 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.065969 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066053 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066288 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066393 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066619 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066703 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.066943 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067027 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067255 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067346 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067574 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067658 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067890 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.067979 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068203 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068295 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068518 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068609 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068836 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.068920 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069153 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069244 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069463 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069545 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069806 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.069894 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070122 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070209 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070438 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070529 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070748 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.070839 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071053 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071138 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071363 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071470 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071677 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071791 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.071985 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072124 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072290 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072423 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072621 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072714 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.072931 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073022 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073271 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073362 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073579 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073676 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.073921 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074017 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074235 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074319 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074540 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074631 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074851 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.074949 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075165 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075277 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075469 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075560 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075778 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.075861 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076084 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076167 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076389 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076480 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076698 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.076781 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077003 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077088 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077308 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077393 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077621 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077737 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.077953 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078038 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078266 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078357 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078570 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078652 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078873 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.078957 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079187 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079294 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079496 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079581 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079813 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.079905 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080124 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080209 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080467 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080549 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080777 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.080869 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081088 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081171 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081413 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081499 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081742 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.081846 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082058 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082142 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082363 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082492 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082673 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082775 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.082982 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083067 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083287 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083399 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083591 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083683 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.083935 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084214 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084329 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084521 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084623 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084830 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.084926 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085144 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085230 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085455 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085574 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085787 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.085878 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086099 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086183 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086402 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086499 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086752 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.086854 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087057 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087143 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087401 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087495 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087708 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.087794 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088018 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088103 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088326 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088422 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088657 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088742 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.088968 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089052 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089281 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089367 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089596 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089681 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.089937 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090022 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090253 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090340 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090578 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090676 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090893 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.090992 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091203 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091289 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091513 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091597 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091823 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.091909 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092136 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092230 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092457 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092556 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092769 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.092924 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093085 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093211 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093397 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093529 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093739 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.093847 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094057 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094143 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094379 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094463 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094685 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.094779 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095001 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095085 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095316 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095401 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095629 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.095725 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.096454 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.096545 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.096768 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.096853 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097087 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097172 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097396 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097479 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097720 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.097807 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098038 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098123 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098350 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098434 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098661 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098752 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.098979 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099063 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099287 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099380 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099602 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099692 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099913 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.099998 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100241 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100325 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100552 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100674 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100864 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.100982 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101165 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101248 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101481 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101642 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101815 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.101901 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102134 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102218 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102445 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102561 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102756 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.102860 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103068 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103163 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103384 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103481 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103707 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.103791 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104020 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104112 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104328 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104420 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104637 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104721 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.104946 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105028 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105254 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105339 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105561 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105645 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105894 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.105978 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106203 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106296 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106519 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106602 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106842 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.106961 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107136 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107234 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107439 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107535 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107749 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.107841 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108068 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108162 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108378 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108472 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108684 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108786 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.108995 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109097 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109297 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109391 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109602 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109739 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.109954 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110050 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110269 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110355 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110574 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110692 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110881 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.110991 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.111186 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.111284 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112091 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112201 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112349 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112437 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112665 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112757 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.112982 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113136 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113277 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113408 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113598 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113759 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.113935 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114021 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114248 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114331 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114556 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114639 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114868 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.114953 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115181 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115263 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115492 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115582 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115802 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.115886 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116113 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116196 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116421 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116514 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116729 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.116812 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117049 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117138 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117355 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117618 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117723 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.117996 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118106 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118315 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118407 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118638 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118723 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.118959 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119043 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119282 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119513 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119606 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119850 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.119941 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120169 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120261 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120493 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120578 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120818 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.120923 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121124 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121233 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121431 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121531 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121769 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.121858 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122079 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122162 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122385 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122474 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122688 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122770 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.122995 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123134 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123294 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123379 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123600 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123683 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123906 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.123998 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124213 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124304 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124517 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124609 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124827 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.124910 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125130 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125222 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125435 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125525 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125787 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.125871 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126097 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126191 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126402 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126487 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126705 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.126787 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127006 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127101 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127335 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127418 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127660 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127744 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.127971 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128065 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128275 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128360 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128581 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128665 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128884 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.128976 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129225 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129308 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129530 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129615 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129868 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.129972 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130181 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130265 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130498 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130603 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130804 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.130908 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131117 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131220 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131420 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131545 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131726 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.131812 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132030 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132113 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132333 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132417 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132641 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132725 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.132945 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133043 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133246 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133341 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133554 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133660 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133892 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.133983 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134202 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134297 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134511 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134604 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134817 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.134902 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135130 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135222 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135430 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135514 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135732 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.135814 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136036 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136128 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136336 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136635 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136724 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.136946 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137040 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137249 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137331 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137549 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137632 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137883 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.137978 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138187 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138275 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138488 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138571 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138789 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.138900 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139091 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139176 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139393 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139483 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139697 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.139787 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140001 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140084 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140304 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140386 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140609 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140701 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140916 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.140999 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141222 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141328 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141524 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141656 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141856 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.141953 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142160 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142254 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142464 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142548 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142791 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.142881 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143097 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143189 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143411 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143507 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143708 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.143791 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144010 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144102 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144310 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144394 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144611 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144694 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144912 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.144996 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145218 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145308 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145519 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145604 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145849 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.145936 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146161 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146245 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146467 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146553 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146796 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.146880 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147105 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147188 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147506 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147724 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.147809 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148029 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148112 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148330 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148423 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148670 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148755 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.148975 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149059 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149287 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149402 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149594 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149726 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.149943 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150048 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150257 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150378 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150572 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150693 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.150878 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151006 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151185 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151335 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151508 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151613 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151822 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.151922 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152135 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152228 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152458 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152549 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152782 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.152867 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153103 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153194 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153459 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153555 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153737 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.153826 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154050 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154135 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154361 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154443 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154673 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154756 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.154986 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155072 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155287 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155370 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155597 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155680 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.155907 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156000 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156215 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156299 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156521 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156614 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156828 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.156919 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157136 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157218 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157445 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157542 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157777 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.157865 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.158087 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.158170 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.158907 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159010 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159221 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159313 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159533 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159617 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159838 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.159930 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160143 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160226 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160446 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160535 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160769 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.160875 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161073 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161195 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161402 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161497 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161682 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.161835 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162018 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162152 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162323 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162467 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162746 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.162831 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163056 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163139 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163366 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163461 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163675 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163772 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.163981 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164094 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164290 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164408 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164604 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164721 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.164999 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165090 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165307 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165400 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165618 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165743 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.165986 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166071 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166299 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166396 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166606 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166691 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166913 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.166997 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167232 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167324 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167538 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167632 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167858 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.167941 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168166 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168274 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168470 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168590 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168774 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.168898 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169096 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169312 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169398 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169626 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169776 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.169967 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170132 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170295 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170445 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170619 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170757 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.170946 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171172 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171257 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171483 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171568 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171793 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.171886 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172119 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172233 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172434 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172518 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172757 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.172850 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.173062 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.173146 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.173365 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.173455 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.173942 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.174053 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.174810 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.174903 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175137 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175227 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175448 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175541 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175763 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.175873 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176068 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176204 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176390 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176520 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176713 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.176846 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177027 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177177 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177350 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177489 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177799 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.177889 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178125 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178208 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178434 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178517 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178743 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.178835 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179066 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179163 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179443 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179539 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179671 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179756 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.179981 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180066 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180290 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180373 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180598 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180744 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.180905 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181070 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181233 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181378 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181539 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181723 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.181893 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182026 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182213 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182338 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182539 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182644 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182861 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.182946 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183170 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183264 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183496 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183583 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183809 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.183893 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184124 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184231 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184432 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184517 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184737 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.184903 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185082 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185220 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185391 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185544 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185734 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.185884 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186074 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186190 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186407 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186496 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186721 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.186806 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187057 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187153 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187388 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187481 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187709 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.187834 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188032 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188181 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188360 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188512 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188668 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188826 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.188976 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189159 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189289 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189488 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189579 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189860 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.189948 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190182 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190266 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190510 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190598 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190824 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.190910 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191128 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191212 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191435 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191529 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191739 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.191823 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192045 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192130 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192352 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192445 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192660 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192751 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.192964 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193048 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193268 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193361 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193572 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193664 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.193920 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194007 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194229 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194335 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194551 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194637 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194861 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.194946 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195197 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195295 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195460 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195548 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195764 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.195849 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196106 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196204 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196411 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196504 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196729 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.196815 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197047 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197139 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197364 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197456 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197684 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.197823 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198016 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198111 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198333 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198424 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198648 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198733 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.198960 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199054 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199277 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199368 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199591 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199688 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.199906 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200110 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200223 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200441 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200525 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200759 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.200846 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201077 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201162 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201395 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201481 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201725 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.201860 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202051 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202272 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202361 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202601 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202759 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.202916 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203003 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203228 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203357 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203542 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203629 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203854 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.203940 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204169 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204373 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204471 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204552 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204777 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.204863 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.205088 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.205182 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.205425 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.205511 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.205778 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.206003 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.206100 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.206414 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.206619 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.206749 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.207066 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.207184 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.207382 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.207663 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.207796 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.208121 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.208235 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.208478 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.208739 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.208946 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.209075 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.209406 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.209490 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.209759 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.210057 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.210151 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.210459 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.210544 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.210865 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.211022 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.211323 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.211407 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.211656 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.211947 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.212038 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.212303 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.212501 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.213082 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.213487 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.213643 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.213828 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.213988 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.214165 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.214303 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.214493 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.214619 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.214942 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.215525 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.215625 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.216107 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.216426 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.216515 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.216757 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.216846 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.217102 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.217205 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.217442 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.217677 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.217802 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218024 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218111 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218367 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218453 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218704 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.218801 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219039 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219126 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219351 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219437 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219670 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219758 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.219986 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.220073 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.220296 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.220392 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.220606 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.220694 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.221444 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.221544 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.221782 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.221872 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222093 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222180 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222417 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222503 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222729 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.222958 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223055 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223315 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223401 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223639 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223751 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.223973 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224168 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224308 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224519 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224632 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224842 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.224951 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225170 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225258 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225501 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225595 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225877 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.225985 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226209 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226297 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226537 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226623 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226846 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.226932 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227152 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227238 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227466 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227560 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227777 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.227871 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228083 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228168 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228386 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228471 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228696 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.228790 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229000 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229086 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229306 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229400 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229615 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229721 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.229946 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230032 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230261 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230358 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230568 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230655 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230874 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.230960 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231181 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231278 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231484 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231569 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231786 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.231870 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232091 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232181 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232397 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232498 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232700 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.232785 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233009 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233103 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233314 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233399 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233619 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233731 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.233950 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234049 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234265 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234351 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234572 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234659 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234877 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.234964 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235180 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235266 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235499 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235584 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235804 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.235890 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236108 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236195 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236424 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236511 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236791 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.236880 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.237115 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.237203 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.237430 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.237657 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.237790 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238070 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238160 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238400 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238494 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238751 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.238929 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239100 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239311 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239398 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239635 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239733 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.239980 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240078 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240322 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240425 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240634 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240729 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.240943 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241029 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241258 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241343 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241574 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241662 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.241912 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242018 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242228 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242313 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242537 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242630 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242849 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.242935 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243159 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243251 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243470 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243560 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243780 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.243872 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244092 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244187 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244403 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244498 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244719 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.244807 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245043 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245136 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245358 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245446 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245686 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.245853 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246016 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246125 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246325 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246634 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246726 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.246963 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247058 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247280 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247373 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247596 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247700 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.247931 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248017 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248266 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248353 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248582 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248682 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.248895 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249000 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249228 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249314 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249555 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249640 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249907 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.249996 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250224 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250312 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250544 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250647 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250857 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.250941 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251180 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251265 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251490 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251588 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251813 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.251899 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.252634 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.252784 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.252957 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253102 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253268 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253401 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253578 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253740 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.253921 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254016 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254256 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254344 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254591 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254677 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254903 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.254999 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255215 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255315 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255526 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255612 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255851 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.255940 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256163 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256249 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256487 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256583 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256799 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.256885 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257115 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257211 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257422 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257517 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257765 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.257868 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258082 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258167 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258397 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258492 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258709 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.258950 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259036 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259301 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259387 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259617 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259704 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.259930 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260015 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260245 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260342 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260552 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260638 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260881 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.260968 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.261201 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.261310 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.261527 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.261631 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.261929 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262032 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262204 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262303 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262530 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262616 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262841 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.262926 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263159 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263246 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263473 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263559 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263785 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.263872 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264106 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264193 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264418 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264510 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264737 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.264835 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265051 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265139 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265367 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265463 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265686 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.265800 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266027 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266115 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266359 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266446 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266688 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.266783 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267017 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267111 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267333 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267650 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.267745 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.268518 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.268616 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.268765 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 10:09:39.268875 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.269208 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.269526 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.269865 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.270178 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:09:39.270424 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 10:09:39.291503 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.292471 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_db.sqlalchemy.engines [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.358501 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.context [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e6ac9ba-2256-4cf3-842a-33e03ff00bfa(cell1) {{(pid=101887) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 10:09:39.358717 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.context [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e6ac9ba-2256-4cf3-842a-33e03ff00bfa(cell1) {{(pid=101886) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 10:09:39.363343 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_concurrency.lockutils [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:09:39.363513 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:09:39.364919 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_concurrency.lockutils [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:09:39.365020 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:09:39.365753 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_concurrency.lockutils [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:09:39.365848 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:09:39.367697 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_concurrency.lockutils [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:09:39.367800 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:09:39.380552 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_db.sqlalchemy.engines [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.383403 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.384748 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.387773 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_db.sqlalchemy.engines [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.641046 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.643831 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG oslo_db.sqlalchemy.engines [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:09:39.981242 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: WARNING keystonemiddleware.auth_token [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:09:39.986091 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: WARNING keystonemiddleware.auth_token [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:09:39.987845 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: WARNING keystonemiddleware.auth_token [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:09:39.992541 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: WARNING keystonemiddleware.auth_token [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:09:40.208688 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: WARNING keystonemiddleware.auth_token [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:09:40.214226 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: WARNING keystonemiddleware.auth_token [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:09:40.217621 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: WARNING keystonemiddleware.auth_token [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:09:40.219560 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b237a69c0 pid: 101886 (default app) Nov 23 10:09:40.221623 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:09:40.222796 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: WARNING keystonemiddleware.auth_token [None req-4f4905a8-b37c-47f9-9ac2-300cfed30eef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:09:40.222890 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Nov 23 10:09:40.223197 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Tue Nov 23 10:09:40 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:09:40.228130 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b237a69c0 pid: 101887 (default app) Nov 23 10:10:59.926780 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:10:59.927773 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Nov 23 10:10:59.928200 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:10:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:00.486884 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-06f7bc86-28d6-45cc-a4e5-59068144f557 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:00.516146 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-06f7bc86-28d6-45cc-a4e5-59068144f557 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.580647 Nov 23 10:11:00.516828 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 23 10:10:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:11:02.833626 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:02.834656 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-7f809811-7521-436a-9a70-07b83d74da18 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Nov 23 10:11:02.835043 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:02.895105 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-af60574d-f129-4253-a525-c284b8d9b7d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:02.913835 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:11:02.913835 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:11:02.941796 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-af60574d-f129-4253-a525-c284b8d9b7d8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100569 Nov 23 10:11:02.942609 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:03.289501 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-f23f6f8a-58ac-49d4-a0b4-ff10f5e1fffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:03.292076 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:11:03.292076 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: warnings.warn(msg) Nov 23 10:11:03.339317 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-f23f6f8a-58ac-49d4-a0b4-ff10f5e1fffc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.388191 Nov 23 10:11:03.341904 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 23 10:11:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:11:05.656393 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-af60574d-f129-4253-a525-c284b8d9b7d8 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:05.657570 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-af60574d-f129-4253-a525-c284b8d9b7d8 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Nov 23 10:11:05.658141 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:05.774730 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-22aa244c-0a80-42d7-8dcb-e943a7e7f12f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:05.792127 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:11:05.792127 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: warnings.warn(msg) Nov 23 10:11:05.813820 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-22aa244c-0a80-42d7-8dcb-e943a7e7f12f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147804 Nov 23 10:11:05.814788 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:05.827572 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-d7cf6c94-223d-40e1-bcba-6ddb0681d15c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:05.829421 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:11:05.829421 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:11:05.864322 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-d7cf6c94-223d-40e1-bcba-6ddb0681d15c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040860 Nov 23 10:11:05.865043 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 23 10:11:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:08.172803 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-22aa244c-0a80-42d7-8dcb-e943a7e7f12f admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:08.174635 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-22aa244c-0a80-42d7-8dcb-e943a7e7f12f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002576 Nov 23 10:11:08.175099 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:08.235292 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-0f2c7bfd-c253-4552-91d6-2660b0efecfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:08.255978 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-0f2c7bfd-c253-4552-91d6-2660b0efecfc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074271 Nov 23 10:11:08.256738 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:11:08.269456 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-49e12f8d-5e92-40f4-9af9-64acf70a0c4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:08.300346 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-49e12f8d-5e92-40f4-9af9-64acf70a0c4e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034659 Nov 23 10:11:08.301195 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 23 10:11:08 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:11:10.651707 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-0f2c7bfd-c253-4552-91d6-2660b0efecfc admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:10.652708 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-0f2c7bfd-c253-4552-91d6-2660b0efecfc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 23 10:11:10.653113 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:10.712126 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-e8b38e10-cb41-4c73-aa80-e6d877a35f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:10.733311 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-e8b38e10-cb41-4c73-aa80-e6d877a35f90 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073666 Nov 23 10:11:10.733901 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:11:10.745985 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-b75176b5-71ad-478d-82b5-9016d6075ec2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:10.770835 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-b75176b5-71ad-478d-82b5-9016d6075ec2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028671 Nov 23 10:11:10.771416 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 23 10:11:10 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:13.079018 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-e8b38e10-cb41-4c73-aa80-e6d877a35f90 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:13.080008 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-e8b38e10-cb41-4c73-aa80-e6d877a35f90 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 23 10:11:13.080572 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:13.141815 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "swap": 0}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:13.160082 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073367 Nov 23 10:11:13.160775 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:11:13.173503 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-4e85d674-9d8e-4952-b21d-dedc71d38889 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:13.195999 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-4e85d674-9d8e-4952-b21d-dedc71d38889 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026693 Nov 23 10:11:13.196800 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Nov 23 10:11:13 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:11:15.556448 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:15.557337 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 23 10:11:15.557771 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:11:15.617360 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-1cf43cfe-e352-4abf-91af-452056044dc4 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:15.643175 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-1cf43cfe-e352-4abf-91af-452056044dc4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078254 Nov 23 10:11:15.644089 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 23 10:11:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:18.245727 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:18.246785 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-470850ff-0061-4aae-b2d6-45ef69ba360c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 23 10:11:18.247194 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:18.316605 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-437ba558-5ba9-4add-b6d9-31af5149a5ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:18.336303 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-437ba558-5ba9-4add-b6d9-31af5149a5ee admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082140 Nov 23 10:11:18.336807 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:18 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:18.350120 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-2d01f94d-eb7f-4e4a-b664-2b6ca2007b48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:18.372976 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-2d01f94d-eb7f-4e4a-b664-2b6ca2007b48 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026604 Nov 23 10:11:18.373862 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 23 10:11:18 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:20.677496 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-437ba558-5ba9-4add-b6d9-31af5149a5ee admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:20.678591 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-437ba558-5ba9-4add-b6d9-31af5149a5ee admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Nov 23 10:11:20.678997 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:20.738247 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-64c81db2-d09f-4cb9-b4e5-96e487ea9df4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "name": "m1.small"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:20.756653 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-64c81db2-d09f-4cb9-b4e5-96e487ea9df4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071486 Nov 23 10:11:20.757223 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:20.772583 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-03f23476-752d-4674-9cf2-94f98a3024bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:20.800232 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-03f23476-752d-4674-9cf2-94f98a3024bf admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032088 Nov 23 10:11:20.805743 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 23 10:11:20 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:23.118598 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-64c81db2-d09f-4cb9-b4e5-96e487ea9df4 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:23.119598 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-64c81db2-d09f-4cb9-b4e5-96e487ea9df4 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 23 10:11:23.119999 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:23.179086 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-34f71932-cd2f-4f23-9c2d-a29fdcef7cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:23.200120 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-34f71932-cd2f-4f23-9c2d-a29fdcef7cb9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073125 Nov 23 10:11:23.200671 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:23 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:23.212958 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-8706e333-8bc5-4446-b85d-7c6b48ab0e97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:23.237061 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-8706e333-8bc5-4446-b85d-7c6b48ab0e97 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027728 Nov 23 10:11:23.237639 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 23 10:11:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:25.600520 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-34f71932-cd2f-4f23-9c2d-a29fdcef7cb9 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:25.602420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-34f71932-cd2f-4f23-9c2d-a29fdcef7cb9 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003632 Nov 23 10:11:25.603157 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:25 2021] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:25.672548 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-d1ffa7fb-148d-4664-af4c-725e6acf7ca8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 80}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:25.694575 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-d1ffa7fb-148d-4664-af4c-725e6acf7ca8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084008 Nov 23 10:11:25.695477 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:25.708760 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-0d46f490-0c33-42c1-bfbc-34d246c5cdd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:25.734335 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-0d46f490-0c33-42c1-bfbc-34d246c5cdd8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029836 Nov 23 10:11:25.735198 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 23 10:11:25 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:28.029306 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-d1ffa7fb-148d-4664-af4c-725e6acf7ca8 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:28.031136 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-d1ffa7fb-148d-4664-af4c-725e6acf7ca8 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Nov 23 10:11:28.031551 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:28.094657 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:28.115835 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077497 Nov 23 10:11:28.116538 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Nov 23 10:11:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:11:28.128592 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-b2d0d95a-c069-4806-a777-5fa4c0e75a5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:28.153514 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-b2d0d95a-c069-4806-a777-5fa4c0e75a5c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028417 Nov 23 10:11:28.154126 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Nov 23 10:11:28 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:11:50.839472 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:50.840475 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 23 10:11:50.840878 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:11:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:50.898849 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-29c5949a-f631-47f5-b44a-37e5a3d348bc admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:50.915517 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-29c5949a-f631-47f5-b44a-37e5a3d348bc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068233 Nov 23 10:11:50.916014 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 23 10:11:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:11:52.410352 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:52.411346 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-b329e806-c824-456c-aaa9-c3cc60971a04 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 23 10:11:52.411739 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:11:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:52.600836 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-f35d1004-127b-479e-92fe-6afa043aebc4 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:52.606270 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.wsgi [None req-f35d1004-127b-479e-92fe-6afa043aebc4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 10:11:52.607464 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-f35d1004-127b-479e-92fe-6afa043aebc4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:52.608298 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-f35d1004-127b-479e-92fe-6afa043aebc4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058246 Nov 23 10:11:52.608812 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 23 10:11:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 10:11:52.618408 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-b4fa03a8-5222-45c9-a1e6-a4c2b929bfbc admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:52.638188 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-b4fa03a8-5222-45c9-a1e6-a4c2b929bfbc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023298 Nov 23 10:11:52.638714 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:52.648319 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-6215a37e-06d3-4e48-998c-771ab1eb0da7 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:52.669684 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-6215a37e-06d3-4e48-998c-771ab1eb0da7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024122 Nov 23 10:11:52.670235 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:52.679761 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-6191c1ab-141e-424f-8a58-3921a9a3b7c0 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:52.684956 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.wsgi [None req-6191c1ab-141e-424f-8a58-3921a9a3b7c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 10:11:52.685507 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-6191c1ab-141e-424f-8a58-3921a9a3b7c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:52.686318 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-6191c1ab-141e-424f-8a58-3921a9a3b7c0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.009965 Nov 23 10:11:52.686798 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 23 10:11:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 10:11:54.060902 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-6215a37e-06d3-4e48-998c-771ab1eb0da7 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:54.061916 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-6215a37e-06d3-4e48-998c-771ab1eb0da7 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 23 10:11:54.062303 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:11:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:54.250452 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-4e967eda-3c0b-4aa6-bdaf-cd00506d750f admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:54.256007 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.wsgi [None req-4e967eda-3c0b-4aa6-bdaf-cd00506d750f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 10:11:54.256555 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-4e967eda-3c0b-4aa6-bdaf-cd00506d750f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:54.257395 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-4e967eda-3c0b-4aa6-bdaf-cd00506d750f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057808 Nov 23 10:11:54.257915 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 23 10:11:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 10:11:54.267387 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-eea92355-e3f3-4b34-bd3b-21e065d8bb04 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:54.281190 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-eea92355-e3f3-4b34-bd3b-21e065d8bb04 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017163 Nov 23 10:11:54.282380 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:54.291547 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-15a9328d-0992-466f-98b5-d19fa2881cfe admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:54.306170 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-15a9328d-0992-466f-98b5-d19fa2881cfe admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017910 Nov 23 10:11:54.306758 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:54.316431 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-f391434e-c2ee-4597-8df0-645391b48f0e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:54.322267 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.wsgi [None req-f391434e-c2ee-4597-8df0-645391b48f0e admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 10:11:54.322826 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-f391434e-c2ee-4597-8df0-645391b48f0e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:54.323603 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-f391434e-c2ee-4597-8df0-645391b48f0e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010703 Nov 23 10:11:54.324096 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Nov 23 10:11:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 10:11:55.695124 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-15a9328d-0992-466f-98b5-d19fa2881cfe admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:55.696107 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-15a9328d-0992-466f-98b5-d19fa2881cfe admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 23 10:11:55.696501 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:11:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:55.883276 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-34cd521a-7728-4a15-8743-a13234a385e4 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:55.888912 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.wsgi [None req-34cd521a-7728-4a15-8743-a13234a385e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 10:11:55.889463 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-34cd521a-7728-4a15-8743-a13234a385e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:55.890273 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-34cd521a-7728-4a15-8743-a13234a385e4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056682 Nov 23 10:11:55.890797 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:11:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 10:11:55.900303 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-b26476eb-ffa5-4986-874c-26c7399ca9a9 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:55.913915 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-b26476eb-ffa5-4986-874c-26c7399ca9a9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016966 Nov 23 10:11:55.914360 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:55.924531 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:55.937211 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016756 Nov 23 10:11:55.937771 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Nov 23 10:11:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:11:55.948104 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-76acae3b-d297-40fa-8c67-e8a82a85ec25 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:55.953872 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.wsgi [None req-76acae3b-d297-40fa-8c67-e8a82a85ec25 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 10:11:55.954420 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-76acae3b-d297-40fa-8c67-e8a82a85ec25 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:11:55.955180 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-76acae3b-d297-40fa-8c67-e8a82a85ec25 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010586 Nov 23 10:11:55.955658 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:11:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 10:11:57.345669 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:57.346680 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 23 10:11:57.347127 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:11:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:57.537965 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-3dbb0478-4059-405c-8f41-a4b27f532a3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:57.555621 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-3dbb0478-4059-405c-8f41-a4b27f532a3e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068618 Nov 23 10:11:57.556092 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 23 10:11:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:11:58.933588 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:11:58.935201 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 23 10:11:58.935592 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:11:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:11:59.125155 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-2ec1e57e-9a04-46c4-b62e-67bf861f41a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:11:59.142635 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-2ec1e57e-9a04-46c4-b62e-67bf861f41a0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067618 Nov 23 10:11:59.143181 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 23 10:11:59 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:12:00.572839 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:00.573862 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 23 10:12:00.574270 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:12:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:12:00.763964 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-93f7f5ce-72be-44c9-8517-2b7a275035ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:12:00.781507 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-93f7f5ce-72be-44c9-8517-2b7a275035ee admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068602 Nov 23 10:12:00.782032 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 23 10:12:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:12:02.178888 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:02.179883 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 23 10:12:02.180275 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:12:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:12:02.374093 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-654fed2c-6461-48e9-93d3-443e329dcf5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:12:02.392296 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-654fed2c-6461-48e9-93d3-443e329dcf5b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071018 Nov 23 10:12:02.392853 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Nov 23 10:12:02 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:12:03.774844 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:03.775827 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 23 10:12:03.776221 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:12:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:12:03.963967 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-48718fef-0b71-4699-a65e-d69594de1f24 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:03.983760 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-48718fef-0b71-4699-a65e-d69594de1f24 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069997 Nov 23 10:12:03.984332 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Tue Nov 23 10:12:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:12:50.535004 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.535999 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-63a11ebd-62e8-48a0-b763-882c280ab88e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 23 10:12:50.536393 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:12:50.594726 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-5b5c9d7c-f6a8-4f9a-8213-d543f2b37e8c admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.613232 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-5b5c9d7c-f6a8-4f9a-8213-d543f2b37e8c admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070587 Nov 23 10:12:50.613792 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:12:50.635126 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-7a4d43b4-8f97-4e3b-9fd6-4dad7d76b3ee admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.643201 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-7a4d43b4-8f97-4e3b-9fd6-4dad7d76b3ee admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011598 Nov 23 10:12:50.643703 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:12:50.655383 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-9436a13b-90ca-41a3-854d-b22e17f06e7b admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.662771 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-9436a13b-90ca-41a3-854d-b22e17f06e7b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011379 Nov 23 10:12:50.663278 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:12:50.674569 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-2729abb8-fbd5-402d-bdb5-e9305730763f admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.681870 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-2729abb8-fbd5-402d-bdb5-e9305730763f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010678 Nov 23 10:12:50.682374 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:12:50.693421 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:12:50.701167 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Nov 23 10:12:50.701670 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Nov 23 10:12:50 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:14:17.921003 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-5837b7a9-70d0-45cf-974b-770327672c48 tempest-verify_tempest_config-1635138728 tempest-verify_tempest_config-1635138728-project] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:14:17.923062 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-5837b7a9-70d0-45cf-974b-770327672c48 tempest-verify_tempest_config-1635138728 tempest-verify_tempest_config-1635138728-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104538 Nov 23 10:14:17.923594 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 23 10:14:17 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:15:49.686922 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:15:49.687912 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 23 10:15:49.688308 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:15:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:15:49.946747 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:15:49.947896 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:15:49.947896 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:15:49.949398 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:15:49.949893 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:15:49.950674 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:15:49.951092 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:15:49.983338 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-6ab03ad7-5515-4a48-aaf4-762c8184b2ac admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.148332 Nov 23 10:15:49.983898 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:15:49 2021] GET /compute/v2.1/os-services => generated 794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:15:51.379083 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:15:51.380015 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Nov 23 10:15:51.380411 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:15:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:15:51.602771 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:15:51.603978 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:15:51.603978 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:15:51.605807 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:15:51.606242 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:15:51.607023 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:15:51.607442 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:15:51.626251 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-cbc02785-af5a-44d7-94e9-61ab154c4ef9 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074244 Nov 23 10:15:51.626790 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:15:51 2021] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:16:03.467180 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:16:03.468170 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 23 10:16:03.468566 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:16:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:16:03.661122 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:16:03.662309 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:16:03.662309 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:16:03.663823 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:16:03.664263 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:16:03.665060 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:16:03.665488 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:16:03.690906 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-eabc8a45-8048-4e18-bafb-78a638b32ed3 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080425 Nov 23 10:16:03.691446 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 37/75] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:16:03 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:16:05.096082 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: DEBUG nova.api.openstack.wsgi [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] Calling method '>' {{(pid=101886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:16:05.097098 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: INFO nova.api.openstack.requestlog [None req-a51c3f5f-e837-4417-9731-fe74dea6e211 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001386 Nov 23 10:16:05.097496 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: [pid: 101886|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Nov 23 10:16:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:16:05.300532 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG nova.api.openstack.wsgi [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] Calling method '>' {{(pid=101887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:16:05.301680 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:16:05.301680 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: warnings.warn(msg) Nov 23 10:16:05.303202 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:16:05.303637 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:16:05.304470 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:16:05.304842 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: DEBUG oslo_concurrency.lockutils [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:16:05.326975 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: INFO nova.api.openstack.requestlog [None req-b9ae7ac4-908b-41a8-9fc6-155b40ecedc9 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080328 Nov 23 10:16:05.327512 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: [pid: 101887|app: 0|req: 38/77] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Nov 23 10:16:05 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:17:04.075802 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: Tue Nov 23 10:17:04 2021 - graceful shutdown triggered... Nov 23 10:17:04.075290 dv-cinder-804035-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 10:17:04.076824 dv-cinder-804035-15-iscsi devstack@n-api.service[101887]: Gracefully killing worker 2 (pid: 101887)... Nov 23 10:17:04.077248 dv-cinder-804035-15-iscsi devstack@n-api.service[101886]: Gracefully killing worker 1 (pid: 101886)... Nov 23 10:17:05.076343 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: worker 1 buried after 1 seconds Nov 23 10:17:05.076343 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: worker 2 buried after 1 seconds Nov 23 10:17:05.077017 dv-cinder-804035-15-iscsi devstack@n-api.service[101885]: goodbye to uWSGI. Nov 23 10:17:05.077971 dv-cinder-804035-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 10:17:05.078553 dv-cinder-804035-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 10:17:05.081422 dv-cinder-804035-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 10:17:05.090471 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 10:17:05 2021] *** Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: nodename: dv-cinder-804035-15-iscsi Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: machine: x86_64 Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: clock source: unix Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: pcre jit disabled Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: detected number of CPU cores: 4 Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: current working directory: / Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: detected binary path: /usr/bin/uwsgi-core Nov 23 10:17:05.092483 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: your processes number limit is 47680 Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: your memory page size is 4096 bytes Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: detected max file descriptor number: 2048 Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: lock engine: pthread robust mutexes Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: thunder lock: enabled Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 10:17:05.093238 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 10:17:05.138601 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: Python main interpreter initialized at 0x55e76051e9c0 Nov 23 10:17:05.138601 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: python threads support enabled Nov 23 10:17:05.138855 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: your server socket listen backlog is limited to 100 connections Nov 23 10:17:05.138855 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: your mercy for graceful operations on workers is 90 seconds Nov 23 10:17:05.138979 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 10:17:05.139044 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: *** Operational MODE: preforking *** Nov 23 10:17:05.139322 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: *** uWSGI is running in multiple interpreter mode *** Nov 23 10:17:05.139322 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: spawned uWSGI master process (pid: 116094) Nov 23 10:17:05.139519 dv-cinder-804035-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 10:17:05.141770 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: spawned uWSGI worker 1 (pid: 116103, cores: 1) Nov 23 10:17:05.141770 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: spawned uWSGI worker 2 (pid: 116104, cores: 1) Nov 23 10:17:05.141770 dv-cinder-804035-15-iscsi devstack@n-api.service[116094]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 10:17:06.959574 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:17:06.959574 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Nov 23 10:17:06.960411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:17:06.960411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Nov 23 10:17:07.129379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:17:07.129379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Nov 23 10:17:07.130073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 10:17:07.130073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Nov 23 10:17:09.329548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 10:17:09.330146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 10:17:09.330378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 10:17:09.330692 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 10:17:09.330949 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 10:17:09.331341 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.331679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.332004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.332325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.332660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.332975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.333298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.333623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.333990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.334250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.334567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.334894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-15-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.335218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.335529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.335841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.336161 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.336466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.336790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.337100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.337604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.339987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.340294 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.340610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.340939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.341248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.341667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-15-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.342029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.342339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.342662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.343070 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.343383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.343695 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.344017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.344344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.344659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.344990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.345316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.345641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.346020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.346329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.346658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.346956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.347278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.347585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.347891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.348147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.348463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.348789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.349112 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.349437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.349718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.349965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.350288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.350640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.350930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.351244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.351561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.351874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.352187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.352499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.352811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.353125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.353446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.353790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.354121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.354435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.354762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.355200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.355458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.355775 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.356122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.356447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.356761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.357084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.357412 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.357745 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.358067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.358382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.358708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.359044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.359351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.359602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.359909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.360218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.360541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.360851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.361163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.361473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.361801 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.362116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.362426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.362736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.363047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.363356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.363661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.363972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.364281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.364587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.364907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.365229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.365537 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.365887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.366196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.366511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.366833 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.367141 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.367451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.367777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.368089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.368395 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.368714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.369024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.369333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.369653 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.369978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.370287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.370606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.371471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.371782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.372091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.372397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.372710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.373030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.373327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.373634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.373978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.374304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.374629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.374944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.375254 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.375565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.375898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.376225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.376557 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.376901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.377213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.377545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.377900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.378225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.378540 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.378858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.379183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.379495 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.379807 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.380118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.380440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.380759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.381090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.381406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.381744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.382072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.382384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.382702 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.383038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.383358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.383672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.384014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.384359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.384674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.385003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.385317 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.385641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.385981 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.386301 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.386704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.387045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.387360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.387679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.388027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.388347 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.388666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.388975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.389281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.389587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.389923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.390234 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.390549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.390877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.391185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.391522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.391829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.392144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.392457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.392762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.393077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.393392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.393723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.394043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.394363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.394670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.394995 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.395317 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.395612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.395926 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.396235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.396549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.396865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.397187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.397503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.397856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.398198 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.399106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.399106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.399451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.399779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.400098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.400403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.400719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.401024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.401331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.401637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.402509 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.402818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.403126 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.403424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.403749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.404039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.404360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.404727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.405037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.405281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.405593 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.405988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.406264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.406606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.406969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.407271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.407581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.407896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.408217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.408527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.408843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.409158 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.409473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.409818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.410549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.410549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.410859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.411063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.411369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.411691 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.411999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.412315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.413025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.413025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.413335 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.413598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.413939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.414255 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.414563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.414877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.415186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.415498 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.415820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.416136 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.416453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.416762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.417086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.417728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.418059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.418365 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.418680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.419009 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.419341 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.419652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.419968 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.420288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.420597 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.420907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.421320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.421522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.421857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.422170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.422485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.422797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.423106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.423411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.423724 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.424032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.424360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.424638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.424949 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.425268 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.425580 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.425937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.426261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.426561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.426868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.427192 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.427504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.427817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.428130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.428434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.428778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.429091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.429397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.429731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.430054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.430364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.430681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.430991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.431299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.431624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.431933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.432242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.432554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.432865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.433734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.434083 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.434420 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.434662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.434972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.435285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.435587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.435950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.436210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.436792 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.437128 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.437445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.437886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.438124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.438449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.438781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.439111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.439427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.439734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.440042 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.440737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.440737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.441020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.441235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.441637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.441897 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.442164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.442465 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.442771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.443106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.443412 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.443728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.444032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.444346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.444653 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.444973 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.445286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.445602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.446373 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.446373 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.446694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.446850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.447162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.447491 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.447832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.448146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.448470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.448768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.449169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.449478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.449807 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.450123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.450435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.450741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.451054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.451368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.451681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.451992 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.452299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.452606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.452910 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.453225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.453535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.453862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.454169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.454479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.454790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.455089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.455402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.455707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.456400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.456400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.456739 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.456898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.457250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.457512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.457839 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.458219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.458481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.458788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.459093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.459401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.459705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.460010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.460320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.460642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.460958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.461259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.461569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.461899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.462208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.462513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.462822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.463124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.463427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.463731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.464035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.464338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.465193 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.466089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.466089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.466089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.466653 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.466901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.467187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.467555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.467866 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.468187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.468596 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.468865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.469142 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.469884 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.469884 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.470187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.470411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.470727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.471035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.471343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.471668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.471985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.472287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.472615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.472937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.473264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.473572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.473909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.474224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.474536 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.474846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.475212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.475466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.475782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.476099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.476411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.476724 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.477387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.477387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.477872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.478022 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.478292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.478610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.479018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.479232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.479545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.479860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.480253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.480694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.481009 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.481321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.481765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.482117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.482435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.482756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.483076 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.483383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.483804 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.484117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.484429 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.484742 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.485048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.485358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.485670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.486034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.486325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.486629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.486934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.487260 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.487564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.487887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.488304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.488622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.488932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.489349 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.489661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.489994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.490320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.490640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.490965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.491272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.491585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.491895 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.492219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.492542 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.492856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.493169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.493476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.493820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.494145 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.494460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.494782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.495198 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.495524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.496446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.496987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.497104 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.497358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.497661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.497996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.498305 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.498613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.498942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.499249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.499563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.499873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.500182 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.500486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.500789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.501111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.501415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.501757 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.502073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.502437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.502769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.503078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.503445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.503852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.504210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.504520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.504886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.505297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.505615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.505989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.506327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.506663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.506979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.507319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.507651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.507996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.508292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.508616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.508928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.509303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.509540 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.510139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.510240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.510485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.510779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.511160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.511616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.512025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.512371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.512776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.513116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.513485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.513870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.514189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.514608 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.515166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.515330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.515800 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.516130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.516463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.516798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.517113 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.517441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.517785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.518107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.518426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.518747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.519072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.519391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.519710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.520023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.520341 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.520659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.520982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.521542 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.521902 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.522224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.522541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.522857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.523179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.523494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.523809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.524124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.524438 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.524751 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.525081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.525406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.525760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.526098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.526418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.526737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.527654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.527974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.528340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.528658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.528971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.529289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.529608 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.529961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.530263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.530576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.530891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.531206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.531517 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.531829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.532144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.532457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.532780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.533114 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.533433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.533783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.534098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.534413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.534930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.535248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.535583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.535914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.536330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.536663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.537044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.540791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.541476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.541476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.541476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.542073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.542812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.543149 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.543497 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.543842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.544298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.544645 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.544985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.545304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.545622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.545977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.546296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.546611 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.546923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.547247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.547563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.547873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.548186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.548499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.548832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.549146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.549457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.549792 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.550109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.550418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.550728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.551037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.551344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.551659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.551965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.552275 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.552582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.552900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.553206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.553517 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.553846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.554175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.554482 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.554787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.555107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.555418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.555743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.556060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.556372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.556722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.557038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.557579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.557983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.558345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.558691 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.559038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.559350 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.559662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.559971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.560297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.560612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.560925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.561235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.561545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.561882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.562195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.562506 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.562819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.563380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.563565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.563770 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.564093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.564416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.564735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.565056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.565369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.565681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.566032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.566348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.566666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.566999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.567316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.567625 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.568208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.575723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.576918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.577155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.577530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.577897 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.578317 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.578684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.579058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.579385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.579704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.580020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.580333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.580665 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.581118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.581538 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.581906 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.582340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.582734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.583105 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.583426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.583762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.584081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.584402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.584719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.585088 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.585543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.585879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.586264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.586660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.587131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.587587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.588056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.588490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.589015 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.589491 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.589942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.590278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.590700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.590942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 10:17:09.602119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 10:17:09.602585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 10:17:09.602876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 10:17:09.603252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 10:17:09.603515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 10:17:09.603914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.604249 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.604583 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.604915 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.605819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.606142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.606471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.606801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.607137 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.607404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.607730 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.608063 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-15-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.608396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.608712 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.609292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.609446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.609812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.610147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.610454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.610973 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.611293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.611613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.611935 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.612284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.612609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.612930 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.613260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.613578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.613943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.614265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.614677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-15-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.615159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.615472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.615803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.616255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.616564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.616884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.617213 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.617555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.617902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.618028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.618271 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.618579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.618909 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.619240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.619558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.619880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.620200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.620530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.621549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.621741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.621989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.622313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.622646 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.622980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.623401 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.623572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.623831 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.624165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.624497 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.624819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.625140 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.625459 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.625809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.626132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.626451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.626770 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.627089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.627423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.627749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.628084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.628406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.628736 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.629151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.629411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.629769 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.630121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.630455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.630777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.631106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.631440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.631760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.632078 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.632398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.632728 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.633072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.633386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.633646 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.633988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.634309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.634638 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.634958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.635279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.635599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.635914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.636233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.638292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.638292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.638292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.638772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.639242 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.639911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.640345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.640681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.641040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.641385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.641970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.642513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.642845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.643179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.643526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.643889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.644262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.644613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.645097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.645664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.646284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.646740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.647077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.647425 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.647749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.648073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.648425 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.648738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.649064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.649386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.650522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.650522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.650522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.650999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.650999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.651278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.651598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.651938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.653030 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.653183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.653447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.653921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 10:17:09.654161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.654508 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.654866 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.655191 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.655538 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.655883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.656228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.656537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.656906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.657249 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.657573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.657931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.658258 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.658595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.658925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.659270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.659605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.659934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.660711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.660711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.661019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.661247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.661549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.661904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.662265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.662620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.662960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.663289 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.663595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.663929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.664255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.664580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.664903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.665249 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.665575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.665930 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.666366 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.666612 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.666940 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.667527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.668382 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.668711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.669019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.669335 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.669678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.670052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.670391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.671040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.671040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.671329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.671632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.671949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.672275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.672596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.672912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.673233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.673792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.674001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.674224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.674537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.674852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.675179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.675500 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.675822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.676145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.676510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.676803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.677125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.677476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.677847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.678166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.678506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.678850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.679169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.679491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.679814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.680133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.680528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.681228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.681228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.681542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.681709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.682004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.682318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.682632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.682971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.683376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.683669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.683994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.684297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.684657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.684974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.685329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.685677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.686036 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.686381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.686683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.687008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.687327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.687652 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.687975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.688299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.688632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.688994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.689285 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.689604 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.689972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.690297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.690680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.691215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.691579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.691579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.691933 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.692262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.692596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.692919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.693244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.693566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.693914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.694245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.694554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.694885 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.695207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.695538 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.695857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.696192 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.696516 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.696846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.697160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.697484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.697855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.698360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.698521 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.699708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.699708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.700028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.700320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.700691 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.701012 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.701511 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.701869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.702028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.702288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.702609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.702926 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.703252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.703679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.703889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.704205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.704516 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.704857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.705181 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.705514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.705877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.706188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.706618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.706839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.707160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.707476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.707792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.708109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.708471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.708794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.709110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.709445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.709804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.710125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.710456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.710778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.711100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.711601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.711770 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.712073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.712365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.712688 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.713013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.713338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.713673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.714018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.714342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.715280 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.715547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.715870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.716199 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.716805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.717149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.717478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.717838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.718175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.718507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.718853 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.719194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.719527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.719880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.720168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.720486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.720803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.721213 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.721792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.721792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.722120 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.722403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.722697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.723013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.723367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.723685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.724320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.724320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.724609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.724926 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.725263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.725585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.725927 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.726681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.726681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.727120 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.727278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.727540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.727883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.728237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.728554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.728871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.729214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.729530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.729872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.730732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.731054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.731378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.731775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.732018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.732327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.732648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.732968 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.733282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.733603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.733944 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.734270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.734590 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.734906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.735219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.735643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.735860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.736175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.736496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.736814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.737148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.737454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.737794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.738113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.738435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.738756 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.739070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.739411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.739735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.740049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.740365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.740695 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.741396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.741396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.742047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.742047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.742424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.742595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.742859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.745963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.747415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.748312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.748312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.748312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.748721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.748884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.749116 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.749441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.749791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.750119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.750438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.750762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.751084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.751407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.751725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.752086 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.752368 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.752690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.753015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.753345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.753681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.754040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.754357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.754679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.755002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.755320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.755639 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.755960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.756285 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.756643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.756929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.757254 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.757579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.757919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.758240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.758561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.758877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.759218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.759539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.759854 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.760174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.760492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.760815 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.761130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.762194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.762474 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.762798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.763126 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.763438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.763763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.764092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.764421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.764739 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.765171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.765498 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.765919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.766179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.766496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.766814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.767135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.767470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.767787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.768103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.768417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.768751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.769074 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.769407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.769874 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.770206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.770607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.770958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.771284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.771610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.771949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.772514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.772746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.772904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.773295 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.773548 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.773910 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.774250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.774576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.774774 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.context [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e6ac9ba-2256-4cf3-842a-33e03ff00bfa(cell1) {{(pid=116103) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 10:17:09.774931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.775207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.775544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.775878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.776203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.776536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.776999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.777946 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.778197 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.778531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.778870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.779193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.779511 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.779729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:09.779883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.780136 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.780456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.780794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.781109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.781303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:09.781469 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.781768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.782092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.782251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:09.782636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.782870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.783032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.783329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.783664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.783991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.784139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:09.784325 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.784659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.784976 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.785312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.785633 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.785979 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.786299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.786616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.787061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.787390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.787725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.788072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.788413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.788738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.789091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.789433 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.790053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.790220 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.790519 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.790888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.791152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.791534 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.791796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.792361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.792972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.793130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.793341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.793671 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.793999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.794339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.794657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.794805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.795611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.795611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.795984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.797686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.797686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.797686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.797686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.797686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.798291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.798291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.798565 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.801871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.803952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.804283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.804613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.804943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.805250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.805377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.805774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.806484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.807762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.807762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.807762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.807762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.808216 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.808698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.809041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.809375 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.809724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.810064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.810444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.810776 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.811097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.811426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.811757 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.812084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.812410 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.812737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.813067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.813392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.813729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.814058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.814386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.814712 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.815052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.815399 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.815730 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.816379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.816718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.817052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.817615 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.817992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.818342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.818680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.819024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.819358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.819692 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.820031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.820351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.820668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.820989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.821312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.821626 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.821997 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.822322 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.822640 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.822971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.823293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.824371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.824737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.825067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.825408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.825779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.826145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.826588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.826934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.827252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.827575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.827904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.828231 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.828550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.828871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.829194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.829517 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.829863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.830185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.830503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.830845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.831163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.831482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.831797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.832119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.832437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.832756 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.833074 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.833391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.833734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.834055 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.834378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.835103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.835103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.835417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.835627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.835943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.836281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.836715 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.837037 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.837367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.837708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.838050 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.838376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.838702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.839069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.839416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.840699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.841110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.841477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.841897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.842215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.842541 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.842865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.843187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.843527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.843854 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.844180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.844503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.844828 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.845153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.845476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.845823 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.846147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.846539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.846878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.847175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.847512 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.847846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.848176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.848506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.848829 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.849154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.849477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.850282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.850282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.850669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.850822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.851091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.851538 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.852024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.852219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.852522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.852848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.853186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.853524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.853879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.854215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.854540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.854886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.855272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.855617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.855958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.856278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.856664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.857025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.857327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.857571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.857943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.858274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.858611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.858946 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.859284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.859609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.859946 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.860281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.860627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.860985 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.861330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.861654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.862008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.862333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.862655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.862978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.864188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.864188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.864188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.864876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.864876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.865182 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.865360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.865553 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.865911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.866256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.866677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.866924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.867239 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.867536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.867865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.868195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.868535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.868881 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.869218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.869558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.869950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.870279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.870754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.871034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.871362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.871693 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.872012 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 10:17:09.872256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 10:17:09.900091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.967451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.context [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e6ac9ba-2256-4cf3-842a-33e03ff00bfa(cell1) {{(pid=116104) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 10:17:09.971731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:09.973310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:09.973433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.974165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:09.976114 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:09.986593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:09.988173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:10.237493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 10:17:10.302428 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:17:10.309024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:17:10.562721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:17:10.569731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:17:10.650812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:17:10.656605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-43b380c8-e12a-4046-83ae-fbe7a37add4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:17:10.661927 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e76051e9c0 pid: 116103 (default app) Nov 23 10:17:10.795048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 10:17:10.800175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-b4d19a3e-631b-4e22-acaa-b1b27e58538f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 10:17:10.805808 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e76051e9c0 pid: 116104 (default app) Nov 23 10:17:44.866797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef8fddf2-df92-43c6-b0d4-0867423cdb81 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Action: 'create', calling method: .version_select at 0x7f9fdd5021f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-853011473", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:45.477444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53339244-f0ee-495f-a03f-5065c98f4dfc tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Action: 'create', calling method: .version_select at 0x7f9fddb6faf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-340828369"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:46.471528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53339244-f0ee-495f-a03f-5065c98f4dfc tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.315778 Nov 23 10:17:46.480685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1154 bytes} [Tue Nov 23 10:17:44 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2327 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 10:17:46.548040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7875ec7f-d659-4b3d-ae00-21e9d05d4cdb tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Action: 'create', calling method: .version_select at 0x7f9fdd4b7b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1661911619", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:46.550005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7875ec7f-d659-4b3d-ae00-21e9d05d4cdb tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.551825 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7875ec7f-d659-4b3d-ae00-21e9d05d4cdb tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.068762 Nov 23 10:17:46.552840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 2/2] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 23 10:17:46 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:17:46.559152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-35b5a7b4-b2e5-49fd-88f6-e922f2ce4e07 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd37c8b0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:46.622192 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-35b5a7b4-b2e5-49fd-88f6-e922f2ce4e07 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 200 len: 344 microversion: 2.1 time: 0.067965 Nov 23 10:17:46.629088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 3/3] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:46 2021] GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:46.636796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67fd1bc5-ebbc-4e4e-a325-0170c2fac0c5 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Action: 'create', calling method: .version_select at 0x7f9fdd37c430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1177220604", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:46.639473 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67fd1bc5-ebbc-4e4e-a325-0170c2fac0c5 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.640747 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67fd1bc5-ebbc-4e4e-a325-0170c2fac0c5 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010066 Nov 23 10:17:46.642020 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 4/4] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 23 10:17:46 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:17:46.654865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b441a15e-d370-423d-a43b-5fb2a572e1da tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Action: 'create', calling method: .version_select at 0x7f9fdd37c280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-627995179", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:46.656602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b441a15e-d370-423d-a43b-5fb2a572e1da tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.658442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b441a15e-d370-423d-a43b-5fb2a572e1da tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010592 Nov 23 10:17:46.659547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 5/5] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 23 10:17:46 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:17:46.671502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d74bcf7-b9d7-4f94-b0b4-0907b8909359 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Calling method '.version_select at 0x7f9fdd36aee0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:46.712476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-0d74bcf7-b9d7-4f94-b0b4-0907b8909359 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] HTTP exception thrown: Volume tempest-invalid-1580335677 could not be found. Nov 23 10:17:46.713494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d74bcf7-b9d7-4f94-b0b4-0907b8909359 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 404 to user: Volume tempest-invalid-1580335677 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.714775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d74bcf7-b9d7-4f94-b0b4-0907b8909359 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1580335677" status: 404 len: 99 microversion: 2.1 time: 0.049256 Nov 23 10:17:46.715812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 6/6] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 23 10:17:46 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1580335677 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 23 10:17:46.729013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a80fa605-3a0f-4cf3-93a2-cf6e8e287a33 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005606 Nov 23 10:17:46.730810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 7/7] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Nov 23 10:17:46 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 10:17:46.750370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-89498969-5e5a-4a11-b3b7-12e94d169547 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003847 Nov 23 10:17:46.755536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 8/8] 10.222.0.41 () {58 vars in 1136 bytes} [Tue Nov 23 10:17:46 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 10:17:46.766275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3d86436-8a14-47fb-b478-4a40191c3f09 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Calling method '.version_select at 0x7f9fdd37c160>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:46.821427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-f3d86436-8a14-47fb-b478-4a40191c3f09 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] HTTP exception thrown: Volume 035ee1f9-c69c-44b4-ab46-c550bb62f75d could not be found. Nov 23 10:17:46.822846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3d86436-8a14-47fb-b478-4a40191c3f09 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 404 to user: Volume 035ee1f9-c69c-44b4-ab46-c550bb62f75d could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.825283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f3d86436-8a14-47fb-b478-4a40191c3f09 tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/035ee1f9-c69c-44b4-ab46-c550bb62f75d" status: 404 len: 109 microversion: 2.1 time: 0.065176 Nov 23 10:17:46.826547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 9/9] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:17:46 2021] DELETE /compute/v2.1/os-volumes/035ee1f9-c69c-44b4-ab46-c550bb62f75d => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 10:17:46.837761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-33b22c75-a5e9-4672-8152-9173ada65e0f tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Calling method '.version_select at 0x7f9fdd36ad30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:46.874293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-33b22c75-a5e9-4672-8152-9173ada65e0f tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] HTTP exception thrown: Volume 0409039f-4008-49a7-9c60-de985eafb6cb could not be found. Nov 23 10:17:46.875244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-33b22c75-a5e9-4672-8152-9173ada65e0f tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] Returning 404 to user: Volume 0409039f-4008-49a7-9c60-de985eafb6cb could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:46.876542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-33b22c75-a5e9-4672-8152-9173ada65e0f tempest-VolumesNegativeTest-1114670430 tempest-VolumesNegativeTest-1114670430-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0409039f-4008-49a7-9c60-de985eafb6cb" status: 404 len: 109 microversion: 2.1 time: 0.043125 Nov 23 10:17:46.877636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 10/10] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:46 2021] GET /compute/v2.1/os-volumes/0409039f-4008-49a7-9c60-de985eafb6cb => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:17:47.583473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef8fddf2-df92-43c6-b0d4-0867423cdb81 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.594049 Nov 23 10:17:47.584308 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1/11] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 23 10:17:43 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 10:17:47.598849 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0ed3ed1-b5d1-48aa-81c2-f2530c41fc3f tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdd36aee0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:47.636875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33d17134-473d-4cbc-843e-a4c4a0418f56 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd3c8dc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:47.712121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0ed3ed1-b5d1-48aa-81c2-f2530c41fc3f tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 200 len: 352 microversion: 2.1 time: 0.118730 Nov 23 10:17:47.715356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 11/12] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:47 2021] GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:47.746578 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33d17134-473d-4cbc-843e-a4c4a0418f56 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 200 len: 345 microversion: 2.1 time: 0.114267 Nov 23 10:17:47.747701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 2/13] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:47 2021] GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:47.758871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a73e9f4a-4bbe-4af4-ac23-c26c65de0e44 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Action: 'create', calling method: .version_select at 0x7f9fdd37c430>, body: {"snapshot": {"volume_id": "ee482527-a924-4f97-8e60-51505cf04155", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-14526035"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:48.046772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a73e9f4a-4bbe-4af4-ac23-c26c65de0e44 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.291596 Nov 23 10:17:48.052392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 12/14] 10.222.0.41 () {60 vars in 1161 bytes} [Tue Nov 23 10:17:47 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:48.058353 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81c40c27-aba1-40e1-9f87-ea38f9245ec7 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd502a60>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:48.199725 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81c40c27-aba1-40e1-9f87-ea38f9245ec7 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 200 len: 285 microversion: 2.1 time: 0.145825 Nov 23 10:17:48.200614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 3/15] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:48 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:48.213705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8fcdb30-ddb4-4d83-a734-d55a30bf4402 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd35a8b0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:48.308759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8fcdb30-ddb4-4d83-a734-d55a30bf4402 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.099035 Nov 23 10:17:48.309325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 4/16] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Nov 23 10:17:48 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:17:48.325647 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30f510a3-1c61-478f-87d7-c0b2a463408a tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd363790>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:48.372913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30f510a3-1c61-478f-87d7-c0b2a463408a tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 200 len: 285 microversion: 2.1 time: 0.050542 Nov 23 10:17:48.373936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 5/17] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:48 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 285 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:17:48.523205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-569054929", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "150b1dc7-2c30-4519-9eae-363eef258738"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:48.743225 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] validate_networks() for [('150b1dc7-2c30-4519-9eae-363eef258738', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:17:49.112915 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-701355578", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "59f47790-eb9f-43a2-a617-bfec07e6a5b9"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:17:49.297722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] validate_networks() for [('59f47790-eb9f-43a2-a617-bfec07e6a5b9', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:17:50.404015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:17:50.404944 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:17:50.405813 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:17:50.406757 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:17:50.409547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:17:50.449282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:50.450096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:50.452810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:50.454411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:50.552718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:17:50.594720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for user 4a87253271364cf6a2052015801aa0d4 and project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:17:50.647322 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:17:50.657082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:17:50.922922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7cb0715b-f068-4057-9b7c-e5ae2a603f7e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.792728 Nov 23 10:17:50.932737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 13/18] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:17:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:17:50.932737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0a754c6a-2f3e-401f-9a6a-1843b178b5f9 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdd2854c0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.047555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0a754c6a-2f3e-401f-9a6a-1843b178b5f9 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 200 len: 353 microversion: 2.1 time: 0.122140 Nov 23 10:17:51.048348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 14/19] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:50 2021] GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:51.053999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-184eb16e-1029-47b1-9fd9-00326a013667 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdc219160>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.107061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-184eb16e-1029-47b1-9fd9-00326a013667 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 200 len: 285 microversion: 2.1 time: 0.056676 Nov 23 10:17:51.107657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 15/20] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:51 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 285 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:51.112762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e31d0c21-3c4e-4f31-859c-091cc74d70b7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.113424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e31d0c21-3c4e-4f31-859c-091cc74d70b7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:51.245506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e31d0c21-3c4e-4f31-859c-091cc74d70b7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:51.262304 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e31d0c21-3c4e-4f31-859c-091cc74d70b7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1217 microversion: 2.1 time: 0.153204 Nov 23 10:17:51.264216 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 16/21] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:51 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:51.271509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f49ad5b0-9800-4b65-8660-826aff5fde5e tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdc22a310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.371305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f49ad5b0-9800-4b65-8660-826aff5fde5e tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 200 len: 353 microversion: 2.1 time: 0.105251 Nov 23 10:17:51.372054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 17/22] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:51 2021] GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:51.388044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1dd2087-45d1-4e43-bb4f-b6e2c658d1c3 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdc22d0d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.466710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:17:51.467560 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:17:51.468364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:17:51.469069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:17:51.471170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:17:51.531030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:51.533999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:51.537514 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:51.539258 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:51.607125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1dd2087-45d1-4e43-bb4f-b6e2c658d1c3 tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 202 len: 0 microversion: 2.1 time: 0.221678 Nov 23 10:17:51.608085 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 18/23] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:17:51 2021] DELETE /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:17:51.616439 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e5ac406e-aa0d-4892-a68d-117103f7dfac tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdc219dc0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.619125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Getting quotas for project 81b02784b80a4736abf3e836279b648a. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:17:51.627419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Getting quotas for user 88381da5afcd48aaa7fea8acc0fee83c and project 81b02784b80a4736abf3e836279b648a. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:17:51.650211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:17:51.653272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:17:51.704929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e5ac406e-aa0d-4892-a68d-117103f7dfac tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 200 len: 352 microversion: 2.1 time: 0.092527 Nov 23 10:17:51.705550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 19/24] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:51 2021] GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:51.800959 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c34fa32b-665e-4a63-927e-bd074a9fbdd3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.073751 Nov 23 10:17:51.805476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 6/25] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:17:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 3080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:17:51.817521 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d92c235-78c7-4509-b738-f3aea1d96bc9 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:51.818645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d92c235-78c7-4509-b738-f3aea1d96bc9 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:52.125524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c33d3c0a-633f-47ca-a11d-7aa66eda8c56 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdca5e5e0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:52.241661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c33d3c0a-633f-47ca-a11d-7aa66eda8c56 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 200 len: 286 microversion: 2.1 time: 0.126298 Nov 23 10:17:52.242672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 7/26] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:52 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:17:52.254516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b4dbb71-4d7f-4f4a-9e8c-de9a3dc77904 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd37cdc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:52.255765 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d92c235-78c7-4509-b738-f3aea1d96bc9 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:52.282662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d92c235-78c7-4509-b738-f3aea1d96bc9 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1214 microversion: 2.1 time: 0.468990 Nov 23 10:17:52.296655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 20/27] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:51 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1214 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:52.308057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4839fc1-0878-4ad0-9ec8-c7713fa8aec5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:52.309336 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f4839fc1-0878-4ad0-9ec8-c7713fa8aec5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:52.381018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b4dbb71-4d7f-4f4a-9e8c-de9a3dc77904 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 202 len: 0 microversion: 2.1 time: 0.130645 Nov 23 10:17:52.382346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 8/28] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Nov 23 10:17:52 2021] DELETE /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:17:52.391820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b33a7afe-3f30-4881-9bde-1b2de7a1ab5e tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdca5e700>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:52.451366 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4839fc1-0878-4ad0-9ec8-c7713fa8aec5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:52.451593 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b33a7afe-3f30-4881-9bde-1b2de7a1ab5e tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 200 len: 285 microversion: 2.1 time: 0.063936 Nov 23 10:17:52.453047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 9/29] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:52 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 285 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:17:52.473570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4839fc1-0878-4ad0-9ec8-c7713fa8aec5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1217 microversion: 2.1 time: 0.174789 Nov 23 10:17:52.492685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 21/30] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:52 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:52.717285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-380a1b3d-6f85-4e80-856c-dec5fac498cb tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Calling method '.version_select at 0x7f9fdca7c670>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:52.765054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-380a1b3d-6f85-4e80-856c-dec5fac498cb tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] HTTP exception thrown: Volume e9478c00-424f-4fda-aac8-54f31d812096 could not be found. Nov 23 10:17:52.766255 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-380a1b3d-6f85-4e80-856c-dec5fac498cb tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] Returning 404 to user: Volume e9478c00-424f-4fda-aac8-54f31d812096 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:52.767366 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-380a1b3d-6f85-4e80-856c-dec5fac498cb tempest-VolumesGetTestJSON-1429414659 tempest-VolumesGetTestJSON-1429414659-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096" status: 404 len: 109 microversion: 2.1 time: 0.053795 Nov 23 10:17:52.777731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 10/31] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:52 2021] GET /compute/v2.1/os-volumes/e9478c00-424f-4fda-aac8-54f31d812096 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:17:53.300540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2769646f-6168-4eb9-986e-d23a97397e09 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:53.302015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2769646f-6168-4eb9-986e-d23a97397e09 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:53.463790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5f739bd-5cb4-45ce-998f-aae136ab7189 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdca7c940>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:53.515080 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e5f739bd-5cb4-45ce-998f-aae136ab7189 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] HTTP exception thrown: Snapshot eebf5f0b-8172-4245-a8d3-6b19d60a6858 could not be found. Nov 23 10:17:53.515783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5f739bd-5cb4-45ce-998f-aae136ab7189 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Returning 404 to user: Snapshot eebf5f0b-8172-4245-a8d3-6b19d60a6858 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:53.516718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5f739bd-5cb4-45ce-998f-aae136ab7189 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858" status: 404 len: 111 microversion: 2.1 time: 0.056499 Nov 23 10:17:53.517659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 11/32] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Nov 23 10:17:53 2021] GET /compute/v2.1/os-snapshots/eebf5f0b-8172-4245-a8d3-6b19d60a6858 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:17:53.525616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:53.539476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:53.566971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2769646f-6168-4eb9-986e-d23a97397e09 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:53.571969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:53.579109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:53.580617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2769646f-6168-4eb9-986e-d23a97397e09 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1214 microversion: 2.1 time: 0.283398 Nov 23 10:17:53.589431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:53.591508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:53.593620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 22/33] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:53 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:53.598551 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2a675be8-4de6-4db2-b3fc-cd41bbf42d8b tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdc219ee0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:53.808994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2a675be8-4de6-4db2-b3fc-cd41bbf42d8b tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 202 len: 0 microversion: 2.1 time: 0.213610 Nov 23 10:17:53.809978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 23/34] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:17:53 2021] DELETE /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:17:53.818519 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f4e7b38-7d7d-4c4f-b8e7-78f8deea3be8 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdc22ac10>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:53.907789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f4e7b38-7d7d-4c4f-b8e7-78f8deea3be8 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 200 len: 344 microversion: 2.1 time: 0.093328 Nov 23 10:17:53.913348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 24/35] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:53 2021] GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:17:54.310264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:54.336786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da406044-8f45-485b-bb0b-07e4e25c63e7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1213 microversion: 2.1 time: 0.814787 Nov 23 10:17:54.337141 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 12/36] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:53 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1213 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:54.598360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:54.599000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:54.618642 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:54.619482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:54.624934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:54.625861 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:54.845681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:54.862651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b622137c-2e10-4d22-9a23-e9e120321f31 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1266 microversion: 2.1 time: 0.267985 Nov 23 10:17:54.875077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 25/37] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:54 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:54.920603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a8d8074-641f-44a9-b688-cac3dc96a9cd tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdd363d30>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:54.968292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-4a8d8074-641f-44a9-b688-cac3dc96a9cd tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] HTTP exception thrown: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. Nov 23 10:17:54.969070 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a8d8074-641f-44a9-b688-cac3dc96a9cd tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Returning 404 to user: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:54.970130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a8d8074-641f-44a9-b688-cac3dc96a9cd tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 404 len: 109 microversion: 2.1 time: 0.053704 Nov 23 10:17:54.975472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 13/38] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:54 2021] GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:17:54.991066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab61c11c-6309-4214-b699-c719457a30d5 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdc1c29d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:55.059409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-ab61c11c-6309-4214-b699-c719457a30d5 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] HTTP exception thrown: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. Nov 23 10:17:55.060358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ab61c11c-6309-4214-b699-c719457a30d5 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Returning 404 to user: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:55.061554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ab61c11c-6309-4214-b699-c719457a30d5 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 404 len: 109 microversion: 2.1 time: 0.081009 Nov 23 10:17:55.069092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 26/39] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:17:54 2021] DELETE /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 10:17:55.072332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2726e8a7-24ef-48cc-ae05-3003da0cd2d9 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Calling method '.version_select at 0x7f9fdc20f4c0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:55.136697 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-2726e8a7-24ef-48cc-ae05-3003da0cd2d9 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] HTTP exception thrown: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. Nov 23 10:17:55.137503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2726e8a7-24ef-48cc-ae05-3003da0cd2d9 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] Returning 404 to user: Volume ee482527-a924-4f97-8e60-51505cf04155 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:17:55.138657 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2726e8a7-24ef-48cc-ae05-3003da0cd2d9 tempest-VolumesSnapshotsTestJSON-1193937298 tempest-VolumesSnapshotsTestJSON-1193937298-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155" status: 404 len: 109 microversion: 2.1 time: 0.071632 Nov 23 10:17:55.140122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 14/40] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:17:55 2021] GET /compute/v2.1/os-volumes/ee482527-a924-4f97-8e60-51505cf04155 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:17:55.356993 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:55.357555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:55.371470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:55.377971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:55.379241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:55.380740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:55.704660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:55.716185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08ea8d6c-4859-4d64-8791-a052e80896f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1275 microversion: 2.1 time: 0.360894 Nov 23 10:17:55.717167 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 27/41] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:55 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:55.880231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:55.880950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:55.910197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:55.911030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:55.912042 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:55.912632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:56.172390 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:56.198998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b880397e-151a-49e0-ab92-41e3b60a7b4d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1272 microversion: 2.1 time: 0.322403 Nov 23 10:17:56.199601 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 15/42] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:55 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:17:56.735893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:56.739391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:56.763554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:56.765290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:56.794392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:56.799903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:57.223833 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:57.224955 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:57.253445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:57.256219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:57.262213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:57.263015 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:58.008146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:58.021852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a8ea66b-4973-4b2c-893d-77ae121f396a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1272 microversion: 2.1 time: 0.807423 Nov 23 10:17:58.027796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 16/43] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:57 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1272 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:58.322857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:17:58.332741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a881d6c-911b-4ab1-9213-02d2d75c974a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 1.600982 Nov 23 10:17:58.349595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 28/44] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:56 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:17:59.044166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:59.044891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:59.052667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:59.060323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:59.062903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:59.075701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:59.351483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:17:59.352419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:17:59.382639 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:59.389803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:59.390939 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:17:59.391394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:17:59.974839 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:00.004550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c99e65e-341d-4d0c-a820-97b58644c94d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1272 microversion: 2.1 time: 0.962354 Nov 23 10:18:00.007409 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 17/45] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:59 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1272 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:00.013617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:00.045957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1475d966-78ed-40d6-aae9-366020860bbf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.694419 Nov 23 10:18:00.048540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 29/46] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:17:59 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:01.034019 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:01.035896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:01.055054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:01.055768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:01.058867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:01.059556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:01.067287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:01.071245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:01.084233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:01.103534 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:01.108001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:01.110403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:01.824763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:01.834708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8188eb3e-3a0e-48a5-8a4d-b17a19b7a468 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.771007 Nov 23 10:18:01.835387 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 30/47] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:01 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:02.293862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:02.309968 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-880b655a-7782-4e79-a7b4-a0a533481dd1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 1.284906 Nov 23 10:18:02.320341 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 18/48] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:01 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:02.836429 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-ff3b0e5d-7dc6-43f0-a4c9-7954212162ec req-bfbd4f58-dfaf-49c2-8341-66a8ceb37c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a2f89c-cd1e-472b-bc51-568cf7ef32ba", "tag": "b572437e-c6ba-4ba4-a235-174248ee5da0"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:02.839732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:02.839732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:18:02.855306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:02.856200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:02.864153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ff3b0e5d-7dc6-43f0-a4c9-7954212162ec req-bfbd4f58-dfaf-49c2-8341-66a8ceb37c83 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:02.866783 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ff3b0e5d-7dc6-43f0-a4c9-7954212162ec req-bfbd4f58-dfaf-49c2-8341-66a8ceb37c83 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:02.877143 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:02.879211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:02.883001 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:02.885858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:02.905576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-ff3b0e5d-7dc6-43f0-a4c9-7954212162ec req-bfbd4f58-dfaf-49c2-8341-66a8ceb37c83 service nova] Creating event network-changed:b572437e-c6ba-4ba4-a235-174248ee5da0 for instance 06a2f89c-cd1e-472b-bc51-568cf7ef32ba on hv-cinder-80403 Nov 23 10:18:02.906731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ff3b0e5d-7dc6-43f0-a4c9-7954212162ec req-bfbd4f58-dfaf-49c2-8341-66a8ceb37c83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 10:18:02.919438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:02.921582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:02.924656 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:02.925248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:02.951709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.compute.rpcapi [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 10:18:02.960117 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] Releasing lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 10:18:03.028412 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc437ea3-a402-4aaa-9bc8-159e0a498e17 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.773847 Nov 23 10:18:03.029423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 31/49] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:03.349495 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:03.352315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:03.382171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:03.390430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:03.391699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:03.394059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:03.814611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:03.823774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ebcdd5a-b62d-4b61-b36f-f226f34dfb68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.484129 Nov 23 10:18:03.832970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 32/50] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:03 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:03.861576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:03.884416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-26d3ed25-aa91-4869-b5df-2fe639cb7580 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 1.035124 Nov 23 10:18:03.901576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 19/51] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:02 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:04.857990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:04.858986 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:04.883014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:04.901379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:04.903811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:04.904643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:05.446744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:05.469295 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38a9e4da-10b9-4d8d-9578-e0cfce39ac8c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.615718 Nov 23 10:18:05.469982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 20/52] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:04 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:05.489923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:05.504007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:05.537339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:05.540879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:05.542755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:05.558480 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:05.703679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-819689891", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c643cb9-cf93-4131-8941-788ccb369a9c"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:05.820398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] validate_networks() for [('8c643cb9-cf93-4131-8941-788ccb369a9c', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:18:05.955649 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:05.973381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb2dbb08-5174-4289-b290-c066e1093165 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.492592 Nov 23 10:18:05.990328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 21/53] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:05 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:06.658836 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: .version_select at 0x7f9fdc15e670>, body: {"keypair": {"name": "tempest-keypair-554836782"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:06.716339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:18:06.725659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:18:06.986671 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:18:07.000600 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:18:07.042153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbac7a6b-414b-4b2d-b2cf-bca3c27d563e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.050572 Nov 23 10:18:07.043096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 22/54] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 23 10:18:05 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1052 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 10:18:07.047918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:07.075789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:07.092903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:07.093662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:07.096406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:07.097455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:07.799826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:18:07.801071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:18:07.801728 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:18:07.802309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:18:07.802879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:18:07.838597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:07.846790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:07.852581 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:07.854452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:07.946502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Getting quotas for project 766b2327a81643d9a2ca87a6f5ba3daa. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:18:07.965048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Getting quotas for user bb8343a33a2e4078b46569105f4a38ce and project 766b2327a81643d9a2ca87a6f5ba3daa. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:18:08.019886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:18:08.027838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:18:08.241544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a7fb868-61cb-4925-b60e-99c329bd7c90 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.654107 Nov 23 10:18:08.259887 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 33/55] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:18:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 3677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:18:08.443121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-130870fe-4f6d-41a4-b9da-2c677e9c3c45 req-f48ff52f-a43b-40a9-85dd-14484047a9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccff6d0-533c-4d30-96da-0b125549a228", "tag": "1edfef11-06fe-48a5-a5c5-7e34d7d467dc"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:08.444822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:08.444822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:18:08.461819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-130870fe-4f6d-41a4-b9da-2c677e9c3c45 req-f48ff52f-a43b-40a9-85dd-14484047a9e5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:08.464178 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-130870fe-4f6d-41a4-b9da-2c677e9c3c45 req-f48ff52f-a43b-40a9-85dd-14484047a9e5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:08.524406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-130870fe-4f6d-41a4-b9da-2c677e9c3c45 req-f48ff52f-a43b-40a9-85dd-14484047a9e5 service nova] Creating event network-changed:1edfef11-06fe-48a5-a5c5-7e34d7d467dc for instance fccff6d0-533c-4d30-96da-0b125549a228 on hv-cinder-80403 Nov 23 10:18:08.548478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-130870fe-4f6d-41a4-b9da-2c677e9c3c45 req-f48ff52f-a43b-40a9-85dd-14484047a9e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286100 Nov 23 10:18:08.557535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 34/56] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:08.576532 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:08.577334 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:08.615355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:08.635268 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:08.640900 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:08.645632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:09.257081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:09.265196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e716ee1b-e3ed-425b-a299-3c46aa16e7a5 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 2.220941 Nov 23 10:18:09.286700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 23/57] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:07 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:09.293603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bdc2a212-bddb-4e1c-a541-53aebb3925f3 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc15e550>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:09.459920 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bdc2a212-bddb-4e1c-a541-53aebb3925f3 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c15c4c9e-1a63-49bd-9149-c07978571d42" status: 200 len: 351 microversion: 2.1 time: 0.171793 Nov 23 10:18:09.460521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 24/58] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:18:09 2021] GET /compute/v2.1/os-volumes/c15c4c9e-1a63-49bd-9149-c07978571d42 => generated 351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:09.473731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2c203a4-ec0f-44df-a7af-10bc8b9652e2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:09.473731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2c203a4-ec0f-44df-a7af-10bc8b9652e2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:09.722552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:09.730875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c260b317-d6f5-4ddd-92b0-cbf89d8828a8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 1.171676 Nov 23 10:18:09.731529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 35/59] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:08 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:09.781666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2c203a4-ec0f-44df-a7af-10bc8b9652e2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:09.804428 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2c203a4-ec0f-44df-a7af-10bc8b9652e2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1221 microversion: 2.1 time: 0.331228 Nov 23 10:18:09.808151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 25/60] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:09 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:10.029603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-161352688", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c643cb9-cf93-4131-8941-788ccb369a9c"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:10.138979 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] validate_networks() for [('8c643cb9-cf93-4131-8941-788ccb369a9c', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:18:10.286237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:10.287638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:10.302567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:10.308679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:10.309773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:10.317475 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:11.096385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:11.108857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33d54169-79a3-49fb-b234-c74cbbe1b1f3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.826125 Nov 23 10:18:11.111440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 26/61] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:10 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:11.128381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:11.131434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:11.149065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:11.149840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:11.168593 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:11.172420 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:11.625927 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:11.638003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81956e99-52dc-4542-a2f5-76ea69c99a97 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.524045 Nov 23 10:18:11.639710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 27/62] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:11 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:11.644962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2b42ef00-0ee1-4d9d-80ea-8123b4a7d9b0 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc20f5e0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:11.746241 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2b42ef00-0ee1-4d9d-80ea-8123b4a7d9b0 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/27c50978-81a1-4932-877a-0a91cdaaf3aa" status: 200 len: 350 microversion: 2.1 time: 0.105249 Nov 23 10:18:11.746825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 28/63] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:18:11 2021] GET /compute/v2.1/os-volumes/27c50978-81a1-4932-877a-0a91cdaaf3aa => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:11.837352 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:18:11.838678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:18:11.839502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:18:11.840059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:18:11.846847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:18:11.881617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:11.885467 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:11.893051 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:11.893519 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:11.994146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Getting quotas for project 766b2327a81643d9a2ca87a6f5ba3daa. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:18:12.016713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Getting quotas for user bb8343a33a2e4078b46569105f4a38ce and project 766b2327a81643d9a2ca87a6f5ba3daa. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:18:12.061864 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:18:12.071589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:18:12.128826 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:12.130008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:12.146277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:12.147072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:12.152276 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:12.153871 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:12.211441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ff72b8b3-bb9e-4de9-8abb-7e89c76e0e98 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.182096 Nov 23 10:18:12.215578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 36/64] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:18:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 2194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 10:18:12.227857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de4ae549-66a2-4221-9ca6-37d1ff03a26d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:12.231379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de4ae549-66a2-4221-9ca6-37d1ff03a26d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:12.528408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de4ae549-66a2-4221-9ca6-37d1ff03a26d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:12.551298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de4ae549-66a2-4221-9ca6-37d1ff03a26d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1221 microversion: 2.1 time: 0.330253 Nov 23 10:18:12.555776 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 37/65] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:12 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1221 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:12.645355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:12.655145 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-962a21b9-9ce3-433d-96bb-fac272409351 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.530742 Nov 23 10:18:12.658444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:12.659672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:12.671012 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 29/66] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:12 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:12.701157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:12.701892 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:12.702895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:12.708898 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:13.413426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd813ef4-27e7-45b9-8c2b-e8f77b6268df tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc20f670>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:13.500186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd813ef4-27e7-45b9-8c2b-e8f77b6268df tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/d697907b-d714-4802-b511-a55516cbda17" status: 200 len: 351 microversion: 2.1 time: 0.090684 Nov 23 10:18:13.500768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 30/67] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Nov 23 10:18:13 2021] GET /compute/v2.1/os-volumes/d697907b-d714-4802-b511-a55516cbda17 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:18:13.513180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d63ded19-bdc7-47bd-a1ce-bf75895a036c tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc168ca0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:13.519087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:13.527487 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea28a8bd-85a8-47f7-b535-76a23aef1371 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.874566 Nov 23 10:18:13.530117 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 38/68] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:12 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:13.568932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:13.569883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:13.585431 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:13.589381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:13.590925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:13.592061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:13.698616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d63ded19-bdc7-47bd-a1ce-bf75895a036c tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.190123 Nov 23 10:18:13.700191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 31/69] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 23 10:18:13 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:13.706635 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:13.707271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:13.725518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:13.726195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:13.729862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:13.731060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:13.778854 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:13.786176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4fb4a5ec-715b-4b41-b3ff-a26dbb3d3a35 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1273 microversion: 2.1 time: 0.221338 Nov 23 10:18:13.798170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 39/70] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:13 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:13.803076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1ec4376-efa4-49a0-b2da-a1cd9514318f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc1c2670>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.023381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1ec4376-efa4-49a0-b2da-a1cd9514318f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224046 Nov 23 10:18:14.024607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 40/71] 10.222.0.41 () {58 vars in 1148 bytes} [Tue Nov 23 10:18:13 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:14.044058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0945d16a-2147-4329-8003-0b839eb0d4e1 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc0d9550>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.070180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:14.089534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ca73a1a3-efe4-4a30-ab83-e0e18a96aff0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.388750 Nov 23 10:18:14.092118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 32/72] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:13 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:14.244935 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0945d16a-2147-4329-8003-0b839eb0d4e1 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.211252 Nov 23 10:18:14.245822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 41/73] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:14.258065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34d18317-76dd-4ace-8858-e26e252fce54 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc116040>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.474562 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34d18317-76dd-4ace-8858-e26e252fce54 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.218775 Nov 23 10:18:14.475740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 33/74] 10.222.0.41 () {58 vars in 1166 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:14.491379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4b75a132-8c12-4d42-889c-82d9772eac0f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc18bca0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.551372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.552278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:14.564199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:14.568314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:14.571405 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:14.573612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:14.688860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4b75a132-8c12-4d42-889c-82d9772eac0f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.202327 Nov 23 10:18:14.690288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 42/75] 10.222.0.41 () {58 vars in 1169 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:18:14.703133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-14c38dcb-3bb2-42a2-a4a3-b30e576fad7f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc161e50>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.903273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-14c38dcb-3bb2-42a2-a4a3-b30e576fad7f tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.203878 Nov 23 10:18:14.914165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 43/76] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:14.921558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:14.924805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:14.941713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:14.944777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:14.951069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:14.951738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:15.091238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:15.101364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-351ea82c-76f1-4613-b4d7-f7bd8726a53b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.556427 Nov 23 10:18:15.111378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 34/77] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:15.117029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-264a9ce8-ab60-4bd9-b64d-65eeff482ce8 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdca5e8b0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:15.152942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:15.175792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-808f18ab-a4d2-4f1b-9ed2-094ae5f2c58b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1279 microversion: 2.1 time: 0.259361 Nov 23 10:18:15.176562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 44/78] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:14 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:15.192162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:15.192994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:15.201590 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:15.202275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:15.206249 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:15.206732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:15.266399 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-264a9ce8-ab60-4bd9-b64d-65eeff482ce8 tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.153247 Nov 23 10:18:15.267585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 35/79] 10.222.0.41 () {58 vars in 1187 bytes} [Tue Nov 23 10:18:15 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:15.280864 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7563846c-657c-46c7-bec6-092e6b14babb tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] Calling method '.version_select at 0x7f9fdc20f700>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:15.536800 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7563846c-657c-46c7-bec6-092e6b14babb tempest-VolumesTestJSON-1726421657 tempest-VolumesTestJSON-1726421657-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.260222 Nov 23 10:18:15.554069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 36/80] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Nov 23 10:18:15 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:15.561402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1260517114", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59babea3-a5f0-410b-9f8a-b0224f381b4f"}], "security_groups": [{"name": "tempest-securitygroup--223434851"}], "key_name": "tempest-keypair-554836782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:15.615362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:15.629013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a20b8ef-8ef9-4703-a578-927c51ac0609 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.451234 Nov 23 10:18:15.629608 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 45/81] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:15 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:15.738150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] validate_networks() for [('59babea3-a5f0-410b-9f8a-b0224f381b4f', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:18:16.091798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e9cced70-837c-4d2b-8145-27d1c9135c5d req-4e9ebbf0-0804-4283-aed7-0bc53be9fa9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe7ef11-1dd1-496b-b4d6-de2f5505c8dc", "tag": "94947f42-bd0e-4ff1-b742-0ca7ed6801ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:16.095801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:16.095801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:18:16.106871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e9cced70-837c-4d2b-8145-27d1c9135c5d req-4e9ebbf0-0804-4283-aed7-0bc53be9fa9c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.107861 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e9cced70-837c-4d2b-8145-27d1c9135c5d req-4e9ebbf0-0804-4283-aed7-0bc53be9fa9c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.124486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e9cced70-837c-4d2b-8145-27d1c9135c5d req-4e9ebbf0-0804-4283-aed7-0bc53be9fa9c service nova] Creating event network-changed:94947f42-bd0e-4ff1-b742-0ca7ed6801ac for instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc on hv-cinder-80403 Nov 23 10:18:16.130484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e9cced70-837c-4d2b-8145-27d1c9135c5d req-4e9ebbf0-0804-4283-aed7-0bc53be9fa9c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043982 Nov 23 10:18:16.132132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 46/82] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:18:16.140830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:16.142016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:16.148738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.149457 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.150741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.151179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.376975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.387345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eabe7add-b713-425c-9c93-36e4ac94e202 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.251985 Nov 23 10:18:16.389038 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 47/83] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:16 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:16.394560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:16.395735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:16.403562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.404131 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.404993 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.405490 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.440211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:18:16.440822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:18:16.441089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:18:16.441494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:18:16.441953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:18:16.451957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.452473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.453358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.453967 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.472481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:18:16.476554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:18:16.497250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:18:16.499875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:18:16.562437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4870f64-b3c3-45a7-b23e-9705169198c0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.006546 Nov 23 10:18:16.562843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 37/84] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 23 10:18:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 10:18:16.584060 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.585857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:16.587310 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:16.592668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c71f24b5-7dcb-4f72-a4a9-07caa5077f4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.201952 Nov 23 10:18:16.594794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 48/85] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:16 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:16.647998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:16.648953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:16.656684 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.657210 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.658180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:16.659107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:16.665055 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.673343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.674904 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.676202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d7f3c76-8550-4f37-812f-f640628e33bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1281 microversion: 2.20 time: 0.107152 Nov 23 10:18:16.687824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 38/86] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:16 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:16.863967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:16.875079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5c895132-c2d3-47fc-918d-b1a724ce980e tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.230421 Nov 23 10:18:16.875755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 49/87] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:16 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:17.404727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:17.405345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:17.411986 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.412226 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.413079 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.413434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.568547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:17.577481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e575e9f8-12c6-4187-b81e-dd66e6b5b806 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.176808 Nov 23 10:18:17.578233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 39/88] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:17 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:17.614525 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:17.615792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:17.639665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.642051 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.644118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.644812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.695689 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:17.696289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:17.706133 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.706603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.708064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:17.708064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:17.885679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:17.918359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:17.945261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:17.948460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-805968fa-471a-4675-8b41-8cbfc187556b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1285 microversion: 2.20 time: 0.257030 Nov 23 10:18:17.976134 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 40/89] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:17 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:17.994614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:17.998964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:18.014920 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:18.015377 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:18.016442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:18.016934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:18.269212 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:18.278898 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-292e76bd-341b-4ecb-961f-76427207fe4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.670316 Nov 23 10:18:18.289806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 50/90] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:17 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:18.570146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:18.596463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:18.597082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:18.607400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb03799e-b616-4094-b075-59a8cb8df729 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.625236 Nov 23 10:18:18.609885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 41/91] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:17 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:18.630620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:18.631101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:18.631924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:18.632364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:18.941019 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c02e5fc0-01f0-4879-94cc-9f832b698442 req-28463630-e138-49e1-8ec8-a9386871928d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba8eea4-a0f8-43c3-9155-9cefef7d797a", "tag": "570571b8-550d-4a67-b91e-43500cd97022"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:18.949429 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:18.949429 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:19.020309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c02e5fc0-01f0-4879-94cc-9f832b698442 req-28463630-e138-49e1-8ec8-a9386871928d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.020638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c02e5fc0-01f0-4879-94cc-9f832b698442 req-28463630-e138-49e1-8ec8-a9386871928d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.095818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c02e5fc0-01f0-4879-94cc-9f832b698442 req-28463630-e138-49e1-8ec8-a9386871928d service nova] Creating event network-changed:570571b8-550d-4a67-b91e-43500cd97022 for instance 7ba8eea4-a0f8-43c3-9155-9cefef7d797a on hv-cinder-80403 Nov 23 10:18:19.097118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c02e5fc0-01f0-4879-94cc-9f832b698442 req-28463630-e138-49e1-8ec8-a9386871928d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 10:18:19.101551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.102417 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.103590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.106301 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.128535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.compute.rpcapi [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 10:18:19.129728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] Releasing lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 10:18:19.187973 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3cf71363-1266-40cc-a108-1d15ec57ed86 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261454 Nov 23 10:18:19.191285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 42/92] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:18:19.200722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:19.206336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:19.221934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.223048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.223951 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.233660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.381174 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:19.404340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:19.408934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:19.420147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1be3ec13-a9df-4c9b-bf74-665bd67dccb6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1339 microversion: 2.20 time: 0.218451 Nov 23 10:18:19.426131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 43/93] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:19 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1339 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:19.441846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:19.451299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:19.464210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.465352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.466503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.467232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.514907 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:19.546863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a40c5f4-bf3b-46cc-92b3-765389fefcb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.953370 Nov 23 10:18:19.562040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 51/94] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:18 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:19.629838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:19.631053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:19.656954 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.663810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:19.664867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:19.665491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.223842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:20.226010 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:20.243863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e65f7afd-ec6f-4a22-a8e1-bbde264aa0e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.614807 Nov 23 10:18:20.246154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 52/95] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:19 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:20.247037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa73955d-d8a5-4b03-897c-9ae036d2058d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.817498 Nov 23 10:18:20.261944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 44/96] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:19 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:20.454662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:20.455921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:20.477189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:20.480552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.486028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:20.488981 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.773872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:20.791663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:20.794697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:20.797162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de467ddd-845f-45f7-87f2-036bed24d93b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1339 microversion: 2.20 time: 0.349166 Nov 23 10:18:20.798067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 53/97] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:20 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:20.804925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:20.806024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:20.808489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-9d5ce951-18b0-480f-acb6-d5dd8e2ccd0f req-c331390d-ee36-4efb-a09c-62baf801e647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccff6d0-533c-4d30-96da-0b125549a228", "name": "network-vif-plugged", "status": "completed", "tag": "1edfef11-06fe-48a5-a5c5-7e34d7d467dc"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:20.811791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:20.811791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:20.817069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:20.818124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.819264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:20.819892 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.830695 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9d5ce951-18b0-480f-acb6-d5dd8e2ccd0f req-c331390d-ee36-4efb-a09c-62baf801e647 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:20.831541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9d5ce951-18b0-480f-acb6-d5dd8e2ccd0f req-c331390d-ee36-4efb-a09c-62baf801e647 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:20.851265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-9d5ce951-18b0-480f-acb6-d5dd8e2ccd0f req-c331390d-ee36-4efb-a09c-62baf801e647 service nova] Creating event network-vif-plugged:1edfef11-06fe-48a5-a5c5-7e34d7d467dc for instance fccff6d0-533c-4d30-96da-0b125549a228 on hv-cinder-80403 Nov 23 10:18:20.863202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-9d5ce951-18b0-480f-acb6-d5dd8e2ccd0f req-c331390d-ee36-4efb-a09c-62baf801e647 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369649 Nov 23 10:18:20.864939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 45/98] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:21.193062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.204064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d238049-406a-4072-84c3-f6d10a26da77 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.404704 Nov 23 10:18:21.215670 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 54/99] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:20 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:21.261185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:21.263175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:21.270128 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:21.270678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:21.279313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.283230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.286556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.288385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.288864 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.289928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.291218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.294917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.504381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.518111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b64b0ba8-e04b-4aa1-ba19-04129b5d482e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.252026 Nov 23 10:18:21.519238 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 55/100] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:21 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:21.544537 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.552014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7e1a6ee-82db-4cae-9e3b-263e6401b417 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.295347 Nov 23 10:18:21.552596 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 46/101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:21 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:21.824869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:21.825395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:21.831549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.832000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.832842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:21.833278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:21.963414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.971087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.972600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:21.973710 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-64bd3864-3ed2-48bd-9a25-7d0253f04abc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.153079 Nov 23 10:18:21.974277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 56/102] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:21 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:22.223164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:22.223770 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:22.230519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.230952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.231728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.232155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.385661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:22.397787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f46c9615-9223-45a9-8742-d15638e375f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.177808 Nov 23 10:18:22.398769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 47/103] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:22 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:22.542032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:22.542558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:22.549352 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.550527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.550784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.551215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.569253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:22.569990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:22.576788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.577380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.578188 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.578614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.693190 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:22.702287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e907f44-45d9-489b-9e63-c94ab3a969ef tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.163998 Nov 23 10:18:22.703095 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 57/104] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:22 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:22.726754 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:22.733972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f54f5299-3488-49bd-8b8e-b2c38da53880 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.168494 Nov 23 10:18:22.734564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 48/105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:22 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:22.885442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b88eb94f-fc6f-4c50-9a0f-ad24c38cd9ef req-4a8f4c44-8dd8-46db-98ae-e9b063264242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a2f89c-cd1e-472b-bc51-568cf7ef32ba", "name": "network-vif-plugged", "status": "completed", "tag": "b572437e-c6ba-4ba4-a235-174248ee5da0"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:22.887145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:22.887145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:18:22.894283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b88eb94f-fc6f-4c50-9a0f-ad24c38cd9ef req-4a8f4c44-8dd8-46db-98ae-e9b063264242 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:22.894715 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b88eb94f-fc6f-4c50-9a0f-ad24c38cd9ef req-4a8f4c44-8dd8-46db-98ae-e9b063264242 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:22.906199 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b88eb94f-fc6f-4c50-9a0f-ad24c38cd9ef req-4a8f4c44-8dd8-46db-98ae-e9b063264242 service nova] Creating event network-vif-plugged:b572437e-c6ba-4ba4-a235-174248ee5da0 for instance 06a2f89c-cd1e-472b-bc51-568cf7ef32ba on hv-cinder-80403 Nov 23 10:18:22.911305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b88eb94f-fc6f-4c50-9a0f-ad24c38cd9ef req-4a8f4c44-8dd8-46db-98ae-e9b063264242 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030152 Nov 23 10:18:22.911916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 58/106] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:22.992238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:22.992845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:23.000907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.001360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.002259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.002669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.148405 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:23.157434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:23.159054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:23.160085 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d77ee41-0abb-48bc-b67a-6715374af43e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.171581 Nov 23 10:18:23.160659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 49/107] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:22 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:23.423841 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:23.424465 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:23.431696 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.432018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.432785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.433221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.578925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:23.586444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eb36eb76-50d0-4da3-bce3-024804033bb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.166768 Nov 23 10:18:23.587590 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 59/108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:23 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:23.721404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:23.722054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:23.734509 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.736087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.737598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.738849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.756703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:23.757729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:23.773680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.778633 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:23.779835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:23.783545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:24.217621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.237905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3fa25ea8-1cd5-435d-af98-a056c20c95ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.519528 Nov 23 10:18:24.242133 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 50/109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:23 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:24.250351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:24.251489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:24.259714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:24.260461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:24.261396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:24.261971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:24.277617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.294795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-43d6da79-be25-43ae-87fa-adf68d7e5d24 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.541470 Nov 23 10:18:24.295911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 60/110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:23 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:24.492731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.502271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.504763 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.506379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa975d87-b853-4eed-afb3-be23b2c46c45 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.262452 Nov 23 10:18:24.507208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 51/111] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:24 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:24.621610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:24.622799 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:24.634426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:24.635221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:24.636535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:24.637282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:24.958066 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-779ee8dd-9d1d-4bd6-a853-304d9809e92b req-dce8eabd-892a-43f5-8bdf-1d3650b7b613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:24.961124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:24.961124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:24.986173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:24.994098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-779ee8dd-9d1d-4bd6-a853-304d9809e92b req-dce8eabd-892a-43f5-8bdf-1d3650b7b613 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:24.994239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-779ee8dd-9d1d-4bd6-a853-304d9809e92b req-dce8eabd-892a-43f5-8bdf-1d3650b7b613 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.014746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4816f6a-7650-4209-8330-e161307a972b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.405352 Nov 23 10:18:25.015824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-779ee8dd-9d1d-4bd6-a853-304d9809e92b req-dce8eabd-892a-43f5-8bdf-1d3650b7b613 service nova] Creating event network-changed:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:18:25.018690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 61/112] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:24 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:25.027809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-779ee8dd-9d1d-4bd6-a853-304d9809e92b req-dce8eabd-892a-43f5-8bdf-1d3650b7b613 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081383 Nov 23 10:18:25.029672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 52/113] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:25.259495 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:25.260450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:25.267299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.267749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.268536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.268967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.319026 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:25.319863 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:25.326989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.327436 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.328238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.328674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.431106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:25.441643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7ed53915-8601-4eea-bf07-def6516c446f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.186825 Nov 23 10:18:25.442446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 62/114] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:25 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:25.512613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:25.519998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d973666e-703e-4250-903c-a5c0d228e2e3 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.205915 Nov 23 10:18:25.520578 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 53/115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:25 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:25.534560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:25.535186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:25.541485 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.541943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.542829 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:25.543356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:25.702321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:25.710755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:25.712333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:25.713452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7a1aa13-f00f-4255-8e7f-00afd2f90bdf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.182766 Nov 23 10:18:25.714099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 63/116] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:25 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:26.033564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:26.034207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:26.043584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.044408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.045798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.046564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.211912 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.219567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73110297-e66c-4217-b05d-02e28d87996a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.189502 Nov 23 10:18:26.220338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 54/117] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:26 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:26.459267 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:26.459867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:26.467327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.467788 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.468537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.469186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.538044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:26.538654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:26.545761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.546210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.546997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.547435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.605658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.614560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9bc7775-2029-47a5-a148-29ab2525a6f5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.158835 Nov 23 10:18:26.624474 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 64/118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:26 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:26.700175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.707352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0494dc0c-c5ef-456d-ac2e-1264cbe6ee68 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.172915 Nov 23 10:18:26.717484 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 55/119] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:26 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:26.730219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:26.730826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:26.739575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.740011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.740956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:26.741391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:26.886301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.894070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.895601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:26.896705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-64c96f26-9601-430c-9184-57e142967e9b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.170237 Nov 23 10:18:26.897272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 65/120] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:26 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:27.236138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:27.236747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:27.242863 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.243809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.244576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.245007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.400257 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:27.408293 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-23d76352-3549-4891-a245-10d9b91bf4be tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.175683 Nov 23 10:18:27.408875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 56/121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:27 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:27.631006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:27.631722 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:27.637711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.638159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.638929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.639364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.723978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:27.724578 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:27.731062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.731503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.732278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.732703 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.768423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:27.775998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9b8b253-dc2d-4267-8494-0993eb24750d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.148551 Nov 23 10:18:27.776616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 66/122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:27 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:27.871958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:27.879733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a4a8ae2-cef6-4e92-86ca-1d5a8f31bcbb tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.159284 Nov 23 10:18:27.880305 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 57/123] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:27 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:27.914838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:27.916336 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:27.922329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.922868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:27.923642 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:27.924067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.055999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:28.063620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:28.065113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:28.066311 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24f4456f-5250-49df-8825-3d2cf3a7828a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.155282 Nov 23 10:18:28.066878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 67/124] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:27 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:28.427525 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:28.428767 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:28.435080 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.435524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.436337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.436736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.604825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:28.619229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80f0b487-fe0f-41e5-9699-8c63d24cf9a9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.194350 Nov 23 10:18:28.620604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 58/125] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:28 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:28.833953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:28.835150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:28.842090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.842544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.843368 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.843805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.898357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:28.900226 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:28.908222 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.908860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:28.909824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:28.910520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:29.004691 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.013301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53a2a4c1-db14-48d5-886b-1b4c551140fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.184572 Nov 23 10:18:29.013922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 68/126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:28 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:29.052173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.060361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3549d00-3453-4ff4-8ac8-73c8f43a91b2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.167825 Nov 23 10:18:29.065285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 59/127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:28 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:29.084067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:29.084585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:29.092274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:29.092841 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:29.093500 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:29.094090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:29.255457 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.263323 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.264816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.265940 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-458fd097-f01f-4655-8f08-0a79c46d37f3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.185566 Nov 23 10:18:29.266717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 69/128] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:29 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:29.636882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:29.637509 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:29.643800 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:29.644249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:29.645032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:29.645466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:29.778699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:29.786065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-900333ce-7de9-4dd1-b5d1-c25f1771d461 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.152777 Nov 23 10:18:29.786652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 60/129] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:29 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:30.029904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:30.030767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:30.036963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.037413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.038221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.038655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.077058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:30.077897 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:30.084036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.084612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.085508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.086172 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.185339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.193869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6fe5f5a3-b4e6-4363-a96a-98e99adb75c6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.167285 Nov 23 10:18:30.194700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 70/130] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:30 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:30.276171 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.295090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d0ebc25-f37f-4b6f-a72d-545c867bebf0 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.221506 Nov 23 10:18:30.295679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 61/131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:30 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:30.299091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:30.299905 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:30.306289 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.306742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.307518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.307979 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.449349 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.457150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.458681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.459773 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-25b912fe-d461-41db-96b2-310e8f176f16 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.178795 Nov 23 10:18:30.460324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 71/132] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:30 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:30.803868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:30.804597 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:30.810573 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.811017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.811786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:30.812224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:30.951799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:30.959199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7587a9a1-243e-48fe-bcf1-e4a922619743 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.159050 Nov 23 10:18:30.959770 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 62/133] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:30 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:31.213040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:31.213683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:31.219579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.220017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.220773 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.221199 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.311761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:31.312378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:31.318512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.318957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.319744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.320173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.376215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:31.384019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-49b35fa4-a445-487c-887a-8bc622539238 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.174579 Nov 23 10:18:31.384596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 72/134] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:31 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:31.461109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:31.468871 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e22790ec-2158-4f35-a399-525609da2ec2 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.160582 Nov 23 10:18:31.469380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 63/135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:31 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:31.478530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:31.479573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:31.485783 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.486274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.486992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.487435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.638983 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:31.646848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:31.648350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:31.650058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e7a3f31-ef87-4a76-b913-b7f081742823 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.175503 Nov 23 10:18:31.650629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 73/136] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:31 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:31.975809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:31.976429 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:31.983080 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.983516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:31.984285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:31.984710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.132682 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.142204 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5e1302a-ef7a-4a6a-8a0f-f08d02d9b230 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.169865 Nov 23 10:18:32.142798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 64/137] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:31 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:32.400703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:32.402301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:32.410015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.410801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.411862 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.412508 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.490749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:32.491369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:32.501979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.502423 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.503221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.503655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.660412 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.669234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-582fb690-1e4d-4040-8353-53be8185d9f4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.272347 Nov 23 10:18:32.670193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 74/138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:32 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:32.674682 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:32.675291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:32.681368 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.681847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.682850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:32.683527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:32.713685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.721633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dc2221e-679a-49b9-badc-aa78d793d2bc tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.234535 Nov 23 10:18:32.722263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 65/139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:32 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:32.824326 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.832003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.833463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:32.834555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b6f071c-3db6-41ca-aeca-aed00eb28da5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.163488 Nov 23 10:18:32.835112 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 75/140] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:32 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:33.159269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:33.159872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:33.166032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.166480 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.167242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.167670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.298087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:33.305368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f5ef74c-4fc2-4e29-a30e-33029767525f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.149787 Nov 23 10:18:33.306456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 66/141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:33 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:33.685839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:33.686442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:33.692338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.692842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.693645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.694109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.738490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:33.739097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:33.745475 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.745941 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.746713 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.747141 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.826875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:33.836626 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-37a4fa5d-ff0a-4fc6-b24f-bb10e8a48ec8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.154069 Nov 23 10:18:33.837801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 76/142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:33 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:33.858251 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:33.858950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:33.864722 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.865104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.865893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:33.866319 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:33.886002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:33.893725 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5788c38-7a84-4775-9d0a-e6a0875db4f1 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.158739 Nov 23 10:18:33.894315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 67/143] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:33 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:34.018482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:34.027771 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:34.029409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:34.030551 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-65e4dc0d-d05f-4c1c-898f-289488cd62ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.176890 Nov 23 10:18:34.031210 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 77/144] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:33 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:34.322565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:34.323183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:34.329119 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.329557 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:34.330393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.330817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:34.475557 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:34.483048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3f3c5b7-0828-42ec-a733-a45a3cf1f2af tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.164622 Nov 23 10:18:34.483639 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 68/145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:34 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:34.855916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:34.856556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:34.864406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.865150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:34.866585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.867232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:34.913707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:34.914224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:34.920896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.921344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:34.922168 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:34.922605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:35.005680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.013089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ffb0e379-69b8-4840-a00b-d79629846451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.160932 Nov 23 10:18:35.013664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 78/146] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:34 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:35.049787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:35.050384 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:35.056166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:35.056602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:35.057363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:35.057817 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:35.062708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.069869 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-577b69c3-039d-4f92-aa36-b525af8bd6aa tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1314 microversion: 2.1 time: 0.159887 Nov 23 10:18:35.070524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 69/147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:34 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:35.190615 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.199154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.200644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.201754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47c0631e-0721-4f67-bdc6-1bcc4bcb4b7c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.155592 Nov 23 10:18:35.202319 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 79/148] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:35 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:35.499796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:35.500424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:35.506389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:35.506832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:35.507598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:35.508031 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:35.641448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:35.648740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93d1d669-ce8f-4bb9-801e-f86aa9724fc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1317 microversion: 2.1 time: 0.152587 Nov 23 10:18:35.649387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 70/149] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:35 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:36.030320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:36.031096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:36.037535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.038047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.039020 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.039517 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.088789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:36.089400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:36.095871 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.096603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.097655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.098252 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.188025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.196598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2bbfce06-3f6f-47a1-8411-f1c45bad551d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.169397 Nov 23 10:18:36.197256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 80/150] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:36 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:36.221577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:36.224718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:36.228967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.229651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.230805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.231464 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.257106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.272332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d69fe1b-f8ab-4520-aaff-3097eaea4415 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1501 microversion: 2.1 time: 0.188661 Nov 23 10:18:36.273136 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 71/151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:36 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:36.377223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.387696 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.389921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.390904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9bb19a40-7a94-46d2-8509-e23c32ec7ae1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.174540 Nov 23 10:18:36.392014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 81/152] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:36 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:36.665308 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:36.666228 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:36.672107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.672561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.673338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:36.673798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:36.831149 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:36.838971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6ed5abb1-8d16-4569-8a38-9431373819d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1507 microversion: 2.1 time: 0.177624 Nov 23 10:18:36.851942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 72/153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:36 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:37.225342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:37.229509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:37.249970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.250989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:37.252438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.253328 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:37.411322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:37.412336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:37.426731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.427334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:37.428146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.428581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:37.446195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:37.456676 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2915393f-99c9-4625-a192-09f9fc867774 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.244838 Nov 23 10:18:37.466441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 82/154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:37 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:37.570931 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:37.579265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:37.581018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:37.581884 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54c0bcda-be57-4ca7-9777-e8bacb1d6a52 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.175455 Nov 23 10:18:37.582844 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 73/155] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:37 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:37.666307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db90ab29-1401-4cac-be59-9ab1cc7b2140"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:37.667418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:37.673483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.674127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:37.674905 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:37.675332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.473941 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:38.474653 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:38.480805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:38.481510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.482381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:38.482814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.659716 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:38.668303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ae35ba6-516e-4962-b654-a179b9761c40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.197891 Nov 23 10:18:38.669752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 74/156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:38 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:38.683636 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-402b9cd6-2f5a-48ee-a630-cbd664444d25 req-cb831aa2-be56-42c2-97ba-1b417e02beed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe7ef11-1dd1-496b-b4d6-de2f5505c8dc", "name": "network-vif-plugged", "status": "completed", "tag": "94947f42-bd0e-4ff1-b742-0ca7ed6801ac"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:38.685909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:38.685909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:38.693531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-402b9cd6-2f5a-48ee-a630-cbd664444d25 req-cb831aa2-be56-42c2-97ba-1b417e02beed service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:38.694140 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-402b9cd6-2f5a-48ee-a630-cbd664444d25 req-cb831aa2-be56-42c2-97ba-1b417e02beed service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.712150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-402b9cd6-2f5a-48ee-a630-cbd664444d25 req-cb831aa2-be56-42c2-97ba-1b417e02beed service nova] Creating event network-vif-plugged:94947f42-bd0e-4ff1-b742-0ca7ed6801ac for instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc on hv-cinder-80403 Nov 23 10:18:38.717622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-402b9cd6-2f5a-48ee-a630-cbd664444d25 req-cb831aa2-be56-42c2-97ba-1b417e02beed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038348 Nov 23 10:18:38.718544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 75/157] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:38.724424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:38.725803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:38.733913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:38.734476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.735468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:38.735981 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:38.882481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:38.891722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:38.893196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:38.894316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-575fa1c2-abf9-4405-9e2d-3680d2572e36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.174987 Nov 23 10:18:38.894883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 76/158] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:38 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:39.687238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:39.687877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:39.693758 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:39.694199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:39.694962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:39.695387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:39.827567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:39.834774 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa312c59-4e07-48fb-8b4d-172a5b7c28db tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.151289 Nov 23 10:18:39.835352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 77/159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:39 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:39.912404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:39.912928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:39.919602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:39.920044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:39.920809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:39.921240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:40.060097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:40.067755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:40.069246 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:40.070576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90355003-c73a-44f4-8e53-ecf47d3f8b96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.161772 Nov 23 10:18:40.071136 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 78/160] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:39 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:18:40.549455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0735a20a-5fc9-4ff6-92b0-ef38a0d94bea tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "POST /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.887616 Nov 23 10:18:40.551097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 83/161] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:18:37 2021] POST /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228/os-volume_attachments => generated 194 bytes in 2890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:40.733722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-90831966-1d2e-457e-b978-6f4ee2ea5dcd req-4656d555-5459-4286-acd6-76c5d9fcc4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba8eea4-a0f8-43c3-9155-9cefef7d797a", "name": "network-vif-plugged", "status": "completed", "tag": "570571b8-550d-4a67-b91e-43500cd97022"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:40.735237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:40.735237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:40.741992 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-90831966-1d2e-457e-b978-6f4ee2ea5dcd req-4656d555-5459-4286-acd6-76c5d9fcc4e0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:40.742430 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-90831966-1d2e-457e-b978-6f4ee2ea5dcd req-4656d555-5459-4286-acd6-76c5d9fcc4e0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:40.753846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-90831966-1d2e-457e-b978-6f4ee2ea5dcd req-4656d555-5459-4286-acd6-76c5d9fcc4e0 service nova] Creating event network-vif-plugged:570571b8-550d-4a67-b91e-43500cd97022 for instance 7ba8eea4-a0f8-43c3-9155-9cefef7d797a on hv-cinder-80403 Nov 23 10:18:40.759717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-90831966-1d2e-457e-b978-6f4ee2ea5dcd req-4656d555-5459-4286-acd6-76c5d9fcc4e0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028802 Nov 23 10:18:40.760078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 79/162] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:40.852734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:40.853458 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:40.859653 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:40.860103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:40.860894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:40.861331 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:41.008390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:41.016408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-59d6c0b2-3fc0-4f4e-87c0-dc3b5e29fc78 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.168164 Nov 23 10:18:41.028115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 84/163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:40 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:41.088675 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:41.089385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:41.096704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:41.097458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:41.098280 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:41.098717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:41.245748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:41.255447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:41.257026 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:41.258195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15401c9c-3d6a-4b5f-955f-945d6906213f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.173581 Nov 23 10:18:41.259417 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 80/164] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:41 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:41.489668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cd79cc7-45f9-4d1b-aab9-79fb3b8df689"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:41.490797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:41.498079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:41.498575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:41.499447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:41.499906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:41.817637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b03a692-10a6-4138-8555-9efdb8441cdf tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332461 Nov 23 10:18:41.818859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 85/165] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:18:41 2021] POST /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:18:42.035203 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:42.036545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:42.048038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:42.048506 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:42.049315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:42.049778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:42.189461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:42.197504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f95e8bf-821e-414a-aefe-5e03d669f475 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1321 microversion: 2.1 time: 0.165880 Nov 23 10:18:42.198021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 81/166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:42 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:42.278769 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:42.279472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:42.290003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:42.291138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:42.292239 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:42.292807 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:42.469047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:42.478487 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:42.480113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:42.481321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-27d806ea-6b3d-4ebe-85b9-b1b43d5ad3d6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.207559 Nov 23 10:18:42.482018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 86/167] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:42 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:42.773939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-8c808780-adae-4266-9334-a1b62438df1a req-59a8dcc6-0236-4189-a210-4beadc294322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "name": "network-vif-plugged", "status": "completed", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:42.775467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:42.775467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:42.782237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-8c808780-adae-4266-9334-a1b62438df1a req-59a8dcc6-0236-4189-a210-4beadc294322 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:42.782674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-8c808780-adae-4266-9334-a1b62438df1a req-59a8dcc6-0236-4189-a210-4beadc294322 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:42.794014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-8c808780-adae-4266-9334-a1b62438df1a req-59a8dcc6-0236-4189-a210-4beadc294322 service nova] Creating event network-vif-plugged:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:18:42.799638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-8c808780-adae-4266-9334-a1b62438df1a req-59a8dcc6-0236-4189-a210-4beadc294322 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029237 Nov 23 10:18:42.800312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 82/168] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:43.214446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:43.215050 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:43.221420 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.222006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.222701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.223123 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.369539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:43.400647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5c8b205e-7c19-40ae-8e72-0424228c243d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1514 microversion: 2.1 time: 0.190333 Nov 23 10:18:43.401351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 87/169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:43 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:43.419346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:43.420492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:43.426680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.427303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.428406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.428791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.502803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:43.504743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:43.513331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lazy-loading 'flavor' on Instance uuid 7ba8eea4-a0f8-43c3-9155-9cefef7d797a {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:18:43.523100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.523477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.524847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.525276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.688602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b0694ab-5585-4dcb-9165-41fe3133b6b1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a/action" status: 200 len: 32 microversion: 2.1 time: 0.273379 Nov 23 10:18:43.689408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 83/170] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:18:43 2021] POST /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:18:43.691403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:43.699301 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:43.699983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:43.700292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:43.701808 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:43.702905 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a305dd0-1f9f-497e-993c-1a9b5b77a892 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.205833 Nov 23 10:18:43.703472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 88/171] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:43 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:43.706661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.707215 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.708049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:43.708544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:43.839023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:43.846418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c4508d3-2ef6-4330-bd0f-fc068e52fc52 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.151731 Nov 23 10:18:43.846987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 84/172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:43 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:44.720334 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:44.720938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:44.727725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:44.728168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:44.728934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:44.729363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:44.862924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:44.863528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:44.866535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:44.869396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:44.869876 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:44.870640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:44.871188 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:44.874607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:44.876084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:44.877161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-067e3f38-8057-455e-af7e-444bedb680d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.160418 Nov 23 10:18:44.877959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 89/173] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:44 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:44.999345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:45.006607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-296dc338-f67c-41d3-bd66-dc41d7ad8afb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.147288 Nov 23 10:18:45.007176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 85/174] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:44 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:45.895822 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:45.896677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:45.905170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:45.905818 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:45.906786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:45.907504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:46.024462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:46.025327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:46.031475 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:46.032036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:46.033246 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:46.036525 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:46.043317 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:46.051097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:46.052796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:46.053943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-04f7ae34-d5da-487f-ab70-2f2b93cab50c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.162143 Nov 23 10:18:46.054509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 90/175] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:45 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:46.185527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:46.192762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9536331d-c283-4c28-84f8-e70b5903f8a4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.172637 Nov 23 10:18:46.193328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 86/176] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:46 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:47.071618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:47.072410 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:47.078322 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:47.078765 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:47.079524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:47.079948 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:47.208955 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:47.209803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:47.216381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:47.216830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:47.217607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:47.218065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:47.227575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:47.235295 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:47.236792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:47.237930 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6cd69e89-18d8-459d-b2b1-d7ecd82dbe70 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.170520 Nov 23 10:18:47.238498 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 91/177] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:47 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:47.350081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:47.357337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d83fec1-eb9e-4f88-980b-b20ee7545c6c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.151951 Nov 23 10:18:47.357938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 87/178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:47 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:48.256019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:48.256629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:48.262950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:48.263398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:48.264207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:48.268656 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:48.374056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:48.374666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:48.380492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:48.380939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:48.381747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:48.382187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:48.394124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:48.404506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:48.406324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:48.408001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ed7d9d37-8f56-4781-8cf6-06a957372c43 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.155052 Nov 23 10:18:48.408001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 92/179] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:48 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:48.515145 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:48.522509 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce730be8-aaaa-42f4-ac75-edd99bb404bc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.152111 Nov 23 10:18:48.523097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 88/180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:48 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:49.426192 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:49.426713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:49.433550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:49.434017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:49.434809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:49.435236 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:49.540861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:49.541531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:49.547752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:49.548187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:49.548958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:49.549384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:49.574438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:49.582430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:49.583929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:49.585035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47743acf-7b37-41ce-b8aa-f110ecc2c057 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.162675 Nov 23 10:18:49.585660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 93/181] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:49 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:49.688550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:49.696442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee22b5e8-7915-43d9-b520-14780b0a0e5b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.160157 Nov 23 10:18:49.697025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 89/182] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:49 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:50.602766 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:50.603380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:50.614556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:50.615001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:50.615799 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:50.616236 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:50.713121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:50.714175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:50.720551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:50.721001 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:50.721859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:50.722294 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:50.760384 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:50.770526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:50.773079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:50.774481 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15a279e0-6985-48da-86a8-5a6b6bf3a597 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1406 microversion: 2.20 time: 0.175402 Nov 23 10:18:50.775202 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 94/183] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:50 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:50.865975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:50.874093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98c92813-f253-4a35-9a83-1d6b9e8e6444 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.164596 Nov 23 10:18:50.874690 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 90/184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:50 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:51.793072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:51.793676 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:51.800099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:51.800548 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:51.801320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:51.801778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:51.891004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:51.891886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:51.898266 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:51.899306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:51.900151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:51.900650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:51.953554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:51.980093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:51.985146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:51.986689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b81dd2ea-2a3f-4909-b8bf-f20562471896 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1597 microversion: 2.20 time: 0.198126 Nov 23 10:18:51.987422 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 95/185] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:18:51 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1597 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:18:52.008084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:52.008777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:52.018470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:52.019095 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:52.020077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:52.020668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:52.094803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:52.104638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86bb84fe-570a-4489-8dc3-4be01484d6df tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.217279 Nov 23 10:18:52.105982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 91/186] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:51 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:52.138314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a3a6c84-2be0-4597-8cf9-85e1003d4eb2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133136 Nov 23 10:18:52.139932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 96/187] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 23 10:18:52 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:18:53.131264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:53.132442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:53.139583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:53.140029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:53.140952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:53.141417 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:53.402581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:53.411456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-18d3dad4-7c60-478e-a2b5-acf8c97254f7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.284108 Nov 23 10:18:53.412305 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 92/188] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:53 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:53.750573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:53.751580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:53.758810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:53.759261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:53.760330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:53.760759 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:53.765546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-2c736f56-a730-44a5-8ecd-28d146728484 req-30744f82-41a9-47e5-b8b1-f31dc3a6970b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:53.767782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:53.767782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:53.778129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2c736f56-a730-44a5-8ecd-28d146728484 req-30744f82-41a9-47e5-b8b1-f31dc3a6970b service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:53.778789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2c736f56-a730-44a5-8ecd-28d146728484 req-30744f82-41a9-47e5-b8b1-f31dc3a6970b service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:53.796886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-2c736f56-a730-44a5-8ecd-28d146728484 req-30744f82-41a9-47e5-b8b1-f31dc3a6970b service nova] Creating event network-changed:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:18:53.802960 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-2c736f56-a730-44a5-8ecd-28d146728484 req-30744f82-41a9-47e5-b8b1-f31dc3a6970b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041429 Nov 23 10:18:53.805564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 93/189] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:53.848164 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45d4f402-3a71-449e-a361-a52ced933a2d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.101498 Nov 23 10:18:53.849176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 97/190] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:18:53 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:54.412784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:54.413519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:54.420656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.421484 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.422789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.423443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.431542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:54.432382 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:54.443130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.444753 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.446489 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.447902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.455304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:18:54.580183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a1ddeea7-55bf-457a-ac02-f48dae17c508 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 204 len: 0 microversion: 2.1 time: 0.171178 Nov 23 10:18:54.581815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 94/191] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:18:54 2021] DELETE /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:18:54.592446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:54.594274 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:54.600991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.602286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.603361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.603997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.862024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:54.870735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8fae1cb5-0cf1-4ad0-a120-646b01f0f905 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1553 microversion: 2.1 time: 0.284315 Nov 23 10:18:54.871864 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 95/192] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:54 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:54.905339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:54.907358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:54.913390 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.913945 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.914805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:54.915227 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:54.957948 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:54.967090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54b10933-2ea6-4748-9bf7-0c9270f181fd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.542267 Nov 23 10:18:54.968471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 98/193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:54 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:55.040796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df62b9f8-c50c-4275-9d0e-a2578b4ac1d3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.167241 Nov 23 10:18:55.041440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 96/194] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:18:54 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:55.889794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:55.890731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:55.898160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:55.898976 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:55.899941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:55.900424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:55.985106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:55.985850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:55.993842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:55.994380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:55.995178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:55.995702 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:56.051912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:56.061453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c391750-5ac5-4d5d-96b1-bb3c52ee889c tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1553 microversion: 2.1 time: 0.176038 Nov 23 10:18:56.062765 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 99/195] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:55 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:56.067713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:56.069093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:56.078571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:56.079023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:56.079844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:56.080333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:56.159764 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-689e04ae-4a48-4def-a908-1698da13475a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.095496 Nov 23 10:18:56.160522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 100/196] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:18:56 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:56.192367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:56.202714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8aae625-78e1-40ac-97be-c6a2c6d7a474 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.221611 Nov 23 10:18:56.203342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 97/197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:55 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:18:57.080160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:57.081035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:57.088383 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.088940 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.089848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.090351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.175383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:57.177470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:57.185877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.186640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.187664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.188330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.263356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:57.274416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-72739b22-9678-4cd1-8363-b91ef7c19df6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1553 microversion: 2.1 time: 0.197387 Nov 23 10:18:57.284366 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 101/198] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:57 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:57.290157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:57.291732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:57.301087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c7dac8b-6122-4a2a-a9a8-9bb6db9d2102 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.130654 Nov 23 10:18:57.304885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 98/199] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:18:57 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:57.305834 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.306682 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.309865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:57.310526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:57.549200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:57.569509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4b8540a8-7685-473e-a32a-aa5e40dd2ed4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.283620 Nov 23 10:18:57.571037 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 102/200] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:57 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:58.295283 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:58.296087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:58.303363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.303697 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:58.304840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.309051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:58.314006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:58.315143 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:58.327645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.328102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:58.331787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.332527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:58.757153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:58.768301 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6af3e5e5-6b43-4aa9-986b-a6f0377b6ad7 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1553 microversion: 2.1 time: 0.479878 Nov 23 10:18:58.769499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 99/201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:58 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:58.784885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:58.786147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:58.793128 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.793632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:58.794536 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:58.795183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:59.125487 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:59.135332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-864bfd62-5b69-4171-ac67-37ee296340e0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.353897 Nov 23 10:18:59.136233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 100/202] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:58 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:18:59.141566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-a1b4ad1b-6177-4086-9581-b9412e8cba39 req-37b7cac7-db48-4c98-ace8-8ea736af9e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccff6d0-533c-4d30-96da-0b125549a228", "name": "network-vif-deleted", "tag": "1edfef11-06fe-48a5-a5c5-7e34d7d467dc"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:18:59.143402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:18:59.143402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:18:59.153107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a1b4ad1b-6177-4086-9581-b9412e8cba39 req-37b7cac7-db48-4c98-ace8-8ea736af9e68 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:59.153613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a1b4ad1b-6177-4086-9581-b9412e8cba39 req-37b7cac7-db48-4c98-ace8-8ea736af9e68 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:59.167552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-a1b4ad1b-6177-4086-9581-b9412e8cba39 req-37b7cac7-db48-4c98-ace8-8ea736af9e68 service nova] Creating event network-vif-deleted:1edfef11-06fe-48a5-a5c5-7e34d7d467dc for instance fccff6d0-533c-4d30-96da-0b125549a228 on hv-cinder-80403 Nov 23 10:18:59.172763 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-a1b4ad1b-6177-4086-9581-b9412e8cba39 req-37b7cac7-db48-4c98-ace8-8ea736af9e68 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035107 Nov 23 10:18:59.173584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 101/203] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:18:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:18:59.788314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:18:59.790774 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:18:59.798210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:59.798852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:59.799805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:18:59.800398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:18:59.936237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:18:59.950958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ea4af7f8-d296-46c6-8f75-92470c7ee542 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1511 microversion: 2.1 time: 0.167008 Nov 23 10:18:59.952163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 102/204] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:18:59 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:00.155329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:00.156859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:00.165915 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:00.166659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:00.167614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:00.168366 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:00.359894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:00.368694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71ff1060-e7b0-4e1a-a191-f0baf4a687d0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.217293 Nov 23 10:19:00.369281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 103/205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:00 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:00.968845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:00.969519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:00.976118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:00.976676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:00.977454 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:00.977921 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:01.039753 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:01.048056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a09de74-44cd-4b04-ad93-d7118c78130a tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1511 microversion: 2.1 time: 0.082886 Nov 23 10:19:01.048629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 104/206] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:00 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:01.385277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:01.385928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:01.391775 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:01.392229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:01.393045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:01.393480 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:01.547863 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:01.556139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9dea39fe-b62c-4d36-8037-00a55b8945ca tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.174438 Nov 23 10:19:01.557334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 105/207] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:01 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:01.604740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38cc9313-cf87-4c05-8942-4f0b99a304cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 3.295495 Nov 23 10:19:01.605919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 103/208] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:18:58 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 3298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:02.065122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:02.065942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:02.073315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.073793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.074591 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.075027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.154849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:02.166219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cf160fd-8a4b-4ba7-878a-c64eb846ba7b tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1345 microversion: 2.1 time: 0.104479 Nov 23 10:19:02.166990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 106/209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:02 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:02.575283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:02.575968 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:02.582202 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.582650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.583410 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.583836 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.616461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:02.618208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:02.627365 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.628140 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.629286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:02.629892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:02.725512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d961b31-b289-489f-adfc-f3b1449ed467 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.112898 Nov 23 10:19:02.726650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 107/210] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:02 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:02.754320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:02.762650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b7400df-ec65-493e-b4db-027d6526448d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.192234 Nov 23 10:19:02.763241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 104/211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:02 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:03.183854 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:03.184547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:03.191664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.191791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.192618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.192930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.255909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88381da5afcd48aaa7fea8acc0fee83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b02784b80a4736abf3e836279b648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:03.265300 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78d57e74-0b8a-4d21-9996-68848f9f449d tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 200 len: 1345 microversion: 2.1 time: 0.085399 Nov 23 10:19:03.266083 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 108/212] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:03 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:03.425408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1650958881", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "150b1dc7-2c30-4519-9eae-363eef258738"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:03.478246 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] validate_networks() for [('150b1dc7-2c30-4519-9eae-363eef258738', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:19:03.736621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:03.737444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:03.744156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.744599 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.745371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.745994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.853062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:19:03.853772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:19:03.854407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:19:03.854819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:19:03.855230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:19:03.860879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f0de0859-0552-4da4-8ddd-3e94ba388eac tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.128104 Nov 23 10:19:03.862211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 109/213] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:03 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:03.867646 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:03.868575 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:03.869097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.869746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.870553 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.871323 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.877328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.877805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.878595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:03.879035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:03.893444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:19:03.899665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for user 4a87253271364cf6a2052015801aa0d4 and project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:19:03.914292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:19:03.917346 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:19:03.987793 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7c70c9ae-a503-4a13-ae2f-fb52e2bcf662 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565796 Nov 23 10:19:03.988405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 105/214] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:19:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:19:04.017281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cbb4dc33-5c66-4eb3-8720-3996e46681f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:04.017946 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cbb4dc33-5c66-4eb3-8720-3996e46681f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:04.087322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:04.097350 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8a6e31a8-2455-4c29-83cd-ba1b3a293e45 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.233441 Nov 23 10:19:04.111541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 110/215] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:03 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:04.134463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cbb4dc33-5c66-4eb3-8720-3996e46681f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:04.141957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cbb4dc33-5c66-4eb3-8720-3996e46681f6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1218 microversion: 2.1 time: 0.136470 Nov 23 10:19:04.143045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 106/216] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:04 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:04.181733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-311335256", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "18a0b218-f324-427b-8941-da18a1690065"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:04.240722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] validate_networks() for [('18a0b218-f324-427b-8941-da18a1690065', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:19:04.303241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:04.304130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:04.312941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.313506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.314483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.315104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.353630 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] HTTP exception thrown: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. Nov 23 10:19:04.357128 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Returning 404 to user: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:04.362204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3c1acb88-a5bf-4cc5-9c8b-be4208fb6bad tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 404 len: 111 microversion: 2.1 time: 0.080572 Nov 23 10:19:04.364091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 107/217] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:04 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:04.630160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:04.631256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:04.645208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.646714 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.650402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.651253 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.686710 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] HTTP exception thrown: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. Nov 23 10:19:04.687501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Returning 404 to user: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:04.690161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c8500bc7-714a-4778-aaa6-784eae4f0742 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064499 Nov 23 10:19:04.692683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 108/218] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:19:04 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:04.763075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:19:04.763498 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:19:04.763971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:19:04.764383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:19:04.764879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:19:04.793164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.794765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.796778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.797237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.848906 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Getting quotas for project 01f57ee10da3422a84977846a2d0df01. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:19:04.859019 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Getting quotas for user f6196c40f4b84ec39130b4be0af585b5 and project 01f57ee10da3422a84977846a2d0df01. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:19:04.872772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:04.873709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:04.883400 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.884381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.886549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:04.887957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:04.897345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:19:04.900233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:19:04.971071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aab03ecf-64db-4579-a8e5-f0c56e2d354a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795559 Nov 23 10:19:04.972202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 111/219] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:19:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:19:04.973992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d7157b8f-7ab6-4ef8-92a0-ed74c344f662 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.105119 Nov 23 10:19:04.974764 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 109/220] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:04 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:04.982321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0095098b-7112-41a1-a040-8ec4bef20d47 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:04.983028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0095098b-7112-41a1-a040-8ec4bef20d47 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:05.041146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0095098b-7112-41a1-a040-8ec4bef20d47 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:05.048170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0095098b-7112-41a1-a040-8ec4bef20d47 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1213 microversion: 2.1 time: 0.069356 Nov 23 10:19:05.048812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 112/221] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:04 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:05.128376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:05.129196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:05.136996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:05.137447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:05.138291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:05.138753 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:05.159468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:05.160076 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:05.166865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:05.167312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:05.168088 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:05.168516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:05.238820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:05.258551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f5745c3-2a7a-4618-9e24-1fb1b0352d0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1270 microversion: 2.1 time: 0.102173 Nov 23 10:19:05.260035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 113/222] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:05 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:05.308417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:05.314900 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2e979a3f-89f1-4725-b30d-aedf9fe98b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.190472 Nov 23 10:19:05.315514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 110/223] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:05 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:05.991660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:05.994859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.002846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.004003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.005388 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.006701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.066240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:06.068476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.079261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.081065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.083541 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.084331 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.110361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a6e1cb3-8757-44dd-8a34-d46589764471 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.125376 Nov 23 10:19:06.114773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 114/224] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:05 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:06.123053 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:06.124771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.133969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.136120 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.138189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.139327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.167240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] HTTP exception thrown: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. Nov 23 10:19:06.168212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Returning 404 to user: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:06.169340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4c36b41-b989-4b6c-b42c-19533327a8af tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 404 len: 111 microversion: 2.1 time: 0.053149 Nov 23 10:19:06.171241 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 115/225] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:19:06 2021] DELETE /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:06.199695 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:06.205110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:06.209644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1457d737-9827-4c1e-9f98-1a732de13102 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1265 microversion: 2.1 time: 0.147930 Nov 23 10:19:06.210005 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] [instance: fccff6d0-533c-4d30-96da-0b125549a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.211707 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 111/226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:06 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:06.231201 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.231847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.232825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.233188 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.254715 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] HTTP exception thrown: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. Nov 23 10:19:06.255595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] Returning 404 to user: Instance fccff6d0-533c-4d30-96da-0b125549a228 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:06.256678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c0ff48f-55d0-4c90-a4c3-8042203f3fe6 tempest-DeleteServersTestJSON-56968552 tempest-DeleteServersTestJSON-56968552-project] 10.222.0.41 "GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228" status: 404 len: 111 microversion: 2.1 time: 0.077549 Nov 23 10:19:06.257564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 116/227] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:06 2021] GET /compute/v2.1/servers/fccff6d0-533c-4d30-96da-0b125549a228 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:06.278109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:06.278725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.306277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.306722 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.307833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.309888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.334972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:06.336626 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:06.357210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.358156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.359762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:06.363687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:06.630054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:06.646989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ed37969-04e1-4f26-9dcd-859f7d2a087b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.317964 Nov 23 10:19:06.656983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 117/228] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:06 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:06.866894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:06.877590 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0a4c7b1-31a3-4175-bcb3-220e66231809 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.604127 Nov 23 10:19:06.878496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 112/229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:06 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:07.125244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:07.126613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:07.141223 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.142870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.143964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.144638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.229380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:07.230657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:07.237162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.238986 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.242483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.244036 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.483094 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:07.498617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c513adc2-1f44-4179-a8f7-0669d1ac792e tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1271 microversion: 2.1 time: 0.273575 Nov 23 10:19:07.516146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 113/230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:07 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:07.532842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0ece608c-0ca4-4b63-90af-03228657c048 req-7639a26f-b451-4557-bda6-949b7c7f2c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce254180-2115-487d-8d54-23117d159234", "tag": "b1774df1-a8ba-4f81-9422-fd03be19793e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:07.535814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:07.535814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:07.547775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0ece608c-0ca4-4b63-90af-03228657c048 req-7639a26f-b451-4557-bda6-949b7c7f2c99 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.547775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0ece608c-0ca4-4b63-90af-03228657c048 req-7639a26f-b451-4557-bda6-949b7c7f2c99 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.561225 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0ece608c-0ca4-4b63-90af-03228657c048 req-7639a26f-b451-4557-bda6-949b7c7f2c99 service nova] Creating event network-changed:b1774df1-a8ba-4f81-9422-fd03be19793e for instance ce254180-2115-487d-8d54-23117d159234 on hv-cinder-80403 Nov 23 10:19:07.566658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0ece608c-0ca4-4b63-90af-03228657c048 req-7639a26f-b451-4557-bda6-949b7c7f2c99 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048389 Nov 23 10:19:07.570508 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 114/231] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:07.664657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:07.665526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:07.674078 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.676980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.678032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.678689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.892022 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:07.901103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-72461796-0e01-4283-b100-97b9938329f2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.240345 Nov 23 10:19:07.902405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 115/232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:07 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:07.907986 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:07.908651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:07.916964 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.917473 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:07.918272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:07.918709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:08.120542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:08.127857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1a84aeec-0663-4629-a267-e39146ddde0d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.224324 Nov 23 10:19:08.128442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 116/233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:07 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:08.526099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:08.527718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:08.534184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:08.534890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:08.535840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:08.536450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:08.686382 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:08.694392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0487f467-3e97-4bb4-ae75-9ca94d4405cb tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.171820 Nov 23 10:19:08.704787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 117/234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:08 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:08.918647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:08.919257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:08.925568 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:08.926242 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:08.927017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:08.927678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:09.077738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:09.086515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4b3b06a-ce39-449e-ba60-496f383e54fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.170909 Nov 23 10:19:09.087169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 118/235] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:08 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:09.146267 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:09.147035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:09.153644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:09.154179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:09.154962 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:09.155476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:09.296783 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:09.303849 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53753637-0243-40c5-9b4f-76c51b857cca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.161305 Nov 23 10:19:09.304491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 119/236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:09 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:09.713588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:09.714255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:09.721344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:09.721816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:09.722866 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:09.723235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:09.863539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:09.873282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f2e265de-f6f4-4e71-bbed-ad5c4a35aec6 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.164579 Nov 23 10:19:09.873779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 120/237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:09 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:09.931671 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-72664326-6edd-432a-8954-3ee3ddbb5e02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 2.811775 Nov 23 10:19:09.936551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 118/238] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:07 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:10.106607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:10.108121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:10.124138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.124831 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.126344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.127030 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.321745 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:10.323064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:10.329923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.330369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.331331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.331914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.731363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:10.743236 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44d1c4b3-ec90-4b9f-bd73-63b8327c88d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.640465 Nov 23 10:19:10.743871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 121/239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:10 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:10.818071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:10.827894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc1cc2a5-fba0-433c-b1d9-3a20d9866f41 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.510967 Nov 23 10:19:10.828730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 119/240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:10 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:10.891616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:10.892315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:10.899292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.899740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.900839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.901648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.945448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:10.947013 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:10.956965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.957809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:10.958281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:10.958718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.045602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cf69c9e-5eb8-416b-ad40-1cede40839ab tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.104803 Nov 23 10:19:11.046548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 120/241] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:10 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:11.151601 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-9cb49012-ab26-4b89-a01b-283bbec6eb14 req-3c43bda5-8277-4bea-a354-c8fa01ad137a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e51201-88ce-4b2a-9594-8c6b9e3ca125", "tag": "3d742cf1-b635-439b-89de-1f9a2543671a"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:11.153122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:11.153122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:11.163556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9cb49012-ab26-4b89-a01b-283bbec6eb14 req-3c43bda5-8277-4bea-a354-c8fa01ad137a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:11.166793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9cb49012-ab26-4b89-a01b-283bbec6eb14 req-3c43bda5-8277-4bea-a354-c8fa01ad137a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.190159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-9cb49012-ab26-4b89-a01b-283bbec6eb14 req-3c43bda5-8277-4bea-a354-c8fa01ad137a service nova] Creating event network-changed:3d742cf1-b635-439b-89de-1f9a2543671a for instance 29e51201-88ce-4b2a-9594-8c6b9e3ca125 on hv-cinder-80403 Nov 23 10:19:11.200750 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-9cb49012-ab26-4b89-a01b-283bbec6eb14 req-3c43bda5-8277-4bea-a354-c8fa01ad137a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052750 Nov 23 10:19:11.201159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 121/242] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:19:11.256154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:11.264755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12a642db-b269-48da-8f66-a3ef3d237532 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.377916 Nov 23 10:19:11.265348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 122/243] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:10 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:11.765554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:11.766358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:11.774549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:11.775306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.776741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:11.777530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.852721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:11.853456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:11.885059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:11.885513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.890379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:11.890897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:11.989958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:12.000472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f6de1ab-7f90-469a-b002-5c7390f07f40 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.241120 Nov 23 10:19:12.001064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 122/244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:11 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:12.060882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:12.062062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:12.071977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:12.072788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:12.073781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:12.074409 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:12.160014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:12.173820 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-73152b07-4fd8-4937-9d9e-7b614c93500d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.331843 Nov 23 10:19:12.175446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 123/245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:11 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:12.200078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d3e1f29-89f3-4833-8792-4aa1f91a4b04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.143656 Nov 23 10:19:12.203982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 123/246] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:12 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:12.285238 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:12.285977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:12.311815 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:12.314843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:12.316230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:12.317318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:12.666733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:12.677595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13c49bc4-9858-4ec8-91ad-f351a6ff719d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.400807 Nov 23 10:19:12.678686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 124/247] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:12 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:13.023833 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:13.025583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:13.034295 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.035376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.036673 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.037752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.192727 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:13.194813 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:13.209832 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.212405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.216163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.216616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.251385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:13.259127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a3e7ec9-f186-44ee-a8b9-d047f2cb6fe2 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.240815 Nov 23 10:19:13.260841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 124/248] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:13 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:13.265506 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:13.266497 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:13.297727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.297894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.298749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.299181 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.395693 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-056b6808-46bc-4bdf-a67b-2a656514af6c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 14 microversion: 2.20 time: 0.133591 Nov 23 10:19:13.396328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 125/249] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:13 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:13.419103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:13.428461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b94e8d8-1c7b-40f6-a71b-7f2e2859db66 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.239865 Nov 23 10:19:13.429720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 125/250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:13 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:13.696193 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:13.696885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:13.714492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.715184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.716103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:13.716496 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:13.911442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:13.919285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89c10f8c-d14e-4182-9dc7-a304f010110c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.228128 Nov 23 10:19:13.920173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 126/251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:13 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:14.294785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:14.296569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:14.303896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.304469 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.305193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.305636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.423418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:14.425358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:14.445299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.446581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.447816 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.448634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.525607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:14.535657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f03f2b3c-889e-47b5-a562-0230e3635790 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.252493 Nov 23 10:19:14.537268 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 126/252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:14 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:14.545958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:14.547843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:14.556974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.557416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.558332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.559042 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.576931 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccc0adcb-4541-4bc2-a4c9-7cbbe8696062 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 8058 microversion: 2.20 time: 0.173225 Nov 23 10:19:14.578689 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 127/253] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:14 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 8058 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:19:14.766556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:14.779847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9455386a-756a-47e9-8c99-6a505bec320a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.238244 Nov 23 10:19:14.781328 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 127/254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:14 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:14.940150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:14.940867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:14.952444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.953587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:14.954700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:14.955612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.168504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:15.177844 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5bef7e1-a3f1-4610-897f-4938bcdde177 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.242444 Nov 23 10:19:15.178447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 128/255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:14 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:15.561105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:15.561750 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:15.569428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.570435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.571279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.571748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.591768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:15.593554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:15.618316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.618316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.618316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.618316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.765132 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a466931-a855-4cf8-8c2f-0f2738571dfc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 12634 microversion: 2.20 time: 0.179428 Nov 23 10:19:15.766043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 129/256] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:15 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 12634 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:15.781608 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:15.797288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d95c2895-c762-4a8f-b639-0eb2a0811b65 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.232646 Nov 23 10:19:15.797288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 128/257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:15 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:15.811049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:15.811049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:15.825521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.826550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:15.828413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:15.829843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.115393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:16.140197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cef957f6-94f2-403c-9a49-3d852262e972 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.335616 Nov 23 10:19:16.140889 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 130/258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:15 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:16.197370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:16.198619 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:16.208149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.208961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.211115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.211766 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.414475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:16.423954 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a787ac3b-8257-4722-ab21-4c2c582dffa1 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.230597 Nov 23 10:19:16.433977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 129/259] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:16 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:16.779195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:16.780891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:16.788577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.789317 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.790511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.791022 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.811059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:16.811673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:16.822796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.823539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.824512 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:16.825131 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:16.929632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-152cbe89-8a12-487c-917e-2f914206586e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 15297 microversion: 2.20 time: 0.152467 Nov 23 10:19:16.930577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 131/260] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:16 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 15297 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:17.018078 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:17.028259 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4af4cd17-2922-473a-aae4-944c6303103c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.224897 Nov 23 10:19:17.039071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 130/261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:16 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:17.165782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:17.166714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:17.176830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.178018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:17.179460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.180381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:17.442896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:17.443664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:17.455080 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.458298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:17.461105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.461659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:17.467209 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:17.484787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8dd0b347-07b7-47c9-bebe-ed19cf70ddd2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.326863 Nov 23 10:19:17.485634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 132/262] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:17 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:17.698411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:17.706001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32d7b652-5ce8-49c3-bbcc-a3fce3448c82 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.267205 Nov 23 10:19:17.708936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 131/263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:17 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:17.943890 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:17.945343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:17.953034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.953638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:17.954766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:17.955358 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.047468 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:18.048086 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:18.060021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.060392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.061178 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.061630 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.078270 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e81aa3e5-c3c7-414f-b30d-8e6a186dd67e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 17861 microversion: 2.20 time: 0.137763 Nov 23 10:19:18.079812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 133/264] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:17 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 17861 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:18.278152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:18.287426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9335e8ac-fc8d-4ead-b400-dfc798580f15 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.244474 Nov 23 10:19:18.295076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 132/265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:18 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:18.503779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:18.504850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:18.512408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.513794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.514678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.515126 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.681568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:18.689005 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bdaaac3e-d4e6-4aea-b9f9-0e6aae9e186d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.189799 Nov 23 10:19:18.689588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 134/266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:18 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:18.729833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:18.730680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:18.737260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.737801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.738648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.739639 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.932156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-248544c4-c4b9-4e73-8a05-a0334da17268 req-7d0bd8c6-3e99-46cf-8704-192781cff4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e51201-88ce-4b2a-9594-8c6b9e3ca125", "name": "network-vif-plugged", "status": "completed", "tag": "3d742cf1-b635-439b-89de-1f9a2543671a"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:18.934348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:18.934348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:18.945394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-248544c4-c4b9-4e73-8a05-a0334da17268 req-7d0bd8c6-3e99-46cf-8704-192781cff4fd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:18.947701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-248544c4-c4b9-4e73-8a05-a0334da17268 req-7d0bd8c6-3e99-46cf-8704-192781cff4fd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:18.963103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:18.969389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-248544c4-c4b9-4e73-8a05-a0334da17268 req-7d0bd8c6-3e99-46cf-8704-192781cff4fd service nova] Creating event network-vif-plugged:3d742cf1-b635-439b-89de-1f9a2543671a for instance 29e51201-88ce-4b2a-9594-8c6b9e3ca125 on hv-cinder-80403 Nov 23 10:19:18.975574 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0290f4e1-2834-4470-a188-5111d682adb2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.253019 Nov 23 10:19:18.976461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-248544c4-c4b9-4e73-8a05-a0334da17268 req-7d0bd8c6-3e99-46cf-8704-192781cff4fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051557 Nov 23 10:19:18.976609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 133/267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:18 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:18.977818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 135/268] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:19.090246 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:19.091943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:19.121141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.121644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.122562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.123224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.249804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3922b1fe-1a77-4e36-b798-42c686d66636 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 17960 microversion: 2.20 time: 0.162966 Nov 23 10:19:19.254449 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 134/269] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:19 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 17960 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:19.308929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:19.309734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:19.320975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.321924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.322822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.323485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.621860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:19.636712 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5fd56a7-af8c-45fa-ad53-47bf173e81f3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.332594 Nov 23 10:19:19.637331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 136/270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:19 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:19.708408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:19.709739 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:19.718045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.718871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.720018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:19.720614 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:19.960736 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:19.974406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-634ce965-512e-49dc-8ba2-e2871f0050fa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.270884 Nov 23 10:19:19.975694 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 135/271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:19 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:19.998245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:19.998847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:20.005911 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.007837 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.008918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.009523 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.172356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:20.188684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50a79b4d-2103-4fa4-ba09-de71d779a3cf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.193260 Nov 23 10:19:20.189940 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 137/272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:19 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:20.264436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:20.265771 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:20.272394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.273435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.274243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.274678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.653818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:20.654631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:20.660451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.660902 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.661706 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:20.662185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:20.819975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:20.829731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96d0adcf-d181-48c3-b87d-bc31076a142b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.179449 Nov 23 10:19:20.833772 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 138/273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:20 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:20.994586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:20.995295 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:21.002867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.003511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.004098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.004522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.193766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:21.201831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7cde4a58-cdee-46fa-b156-bf2b2ea69ae4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.212722 Nov 23 10:19:21.202484 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 139/274] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:20 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:21.216364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-2228de27-6d70-4933-b696-133cd1928b10 req-2faea2b0-b643-4cdb-8cd8-8433b00121ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce254180-2115-487d-8d54-23117d159234", "name": "network-vif-plugged", "status": "completed", "tag": "b1774df1-a8ba-4f81-9422-fd03be19793e"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:21.217998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:21.217998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:21.226351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2228de27-6d70-4933-b696-133cd1928b10 req-2faea2b0-b643-4cdb-8cd8-8433b00121ba service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.226888 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2228de27-6d70-4933-b696-133cd1928b10 req-2faea2b0-b643-4cdb-8cd8-8433b00121ba service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.240848 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-2228de27-6d70-4933-b696-133cd1928b10 req-2faea2b0-b643-4cdb-8cd8-8433b00121ba service nova] Creating event network-vif-plugged:b1774df1-a8ba-4f81-9422-fd03be19793e for instance ce254180-2115-487d-8d54-23117d159234 on hv-cinder-80403 Nov 23 10:19:21.245856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-2228de27-6d70-4933-b696-133cd1928b10 req-2faea2b0-b643-4cdb-8cd8-8433b00121ba service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042058 Nov 23 10:19:21.246455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 140/275] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:21.251386 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:21.252073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:21.259141 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.259599 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.260564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.261081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.454700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:21.463964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3790260e-5544-40bf-8092-0e3935685d15 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.216224 Nov 23 10:19:21.464564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 141/276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:21 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:21.848155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:21.849034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:21.861363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.861363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:21.863962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:21.864877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:22.092535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:22.106516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f3ea21b4-529b-47a2-ace2-c1c345e17b81 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.261567 Nov 23 10:19:22.106516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 142/277] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:21 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:22.219842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:22.220539 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:22.228332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:22.228812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:22.230024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:22.230603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:22.399235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:22.406703 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a3fe302-67f7-46ec-a4d7-a2abc629c710 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.190417 Nov 23 10:19:22.407281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 143/278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:22 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:22.481452 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:22.482102 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:22.487830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:22.488274 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:22.489043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:22.489467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:22.638499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:22.647069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06cf9b2e-1844-48c1-a33a-1d54e83cd145 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.169117 Nov 23 10:19:22.658183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 144/279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:22 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:22.851892 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e3843af6-032c-4936-9728-8a655b44e56d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 23234 microversion: 2.20 time: 2.590816 Nov 23 10:19:22.853266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 136/280] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:20 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 23234 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:23.122880 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:23.123486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:23.129710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.130160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.130937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.131368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.293986 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:23.302590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74af178d-3131-4daf-b8f8-5f4728b43ad5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.183375 Nov 23 10:19:23.303269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 145/281] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:23 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:23.424643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:23.425377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:23.432601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.433735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.433834 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.434259 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.638896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:23.648671 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-007095e5-898f-45a6-994c-4cbf401caf73 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.227928 Nov 23 10:19:23.649252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 137/282] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:23 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:23.671393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:23.672396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:23.678875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.681102 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.681906 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:23.682595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:23.856011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-599663279", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "60bfbda0-c680-4ce8-8529-cba547c6f159"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:23.919168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] validate_networks() for [('60bfbda0-c680-4ce8-8529-cba547c6f159', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:19:23.955812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:23.972932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b925722-f90b-4a0b-9ae7-e0483d87a966 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1313 microversion: 2.1 time: 0.305653 Nov 23 10:19:23.973531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 146/283] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:23 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:23.989059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:23.991110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:24.023873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.024558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.030421 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.032179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.159205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f829a6eb-655e-4b9a-8519-03461b9a458e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 23884 microversion: 2.20 time: 0.180654 Nov 23 10:19:24.160802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 147/284] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:23 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 23884 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:24.324899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:24.329988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:24.341704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.343354 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.348205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.351640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.537593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:19:24.537826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:19:24.538693 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:19:24.538899 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:19:24.540404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:19:24.552449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:24.553869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.554619 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.556049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.556860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.564764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7e3f7fc-de3c-4d7d-b566-4bd200959634 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.246620 Nov 23 10:19:24.566764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 148/285] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:24 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:24.579953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Getting quotas for project 436a5a3020ea46dfb81f427e8c9f0163. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:19:24.586153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Getting quotas for user 65d9c8d8f04c4ff6a12bc1b1645f09aa and project 436a5a3020ea46dfb81f427e8c9f0163. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:19:24.613033 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:19:24.619418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:19:24.677482 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:24.679997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:24.700475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9edec500-da43-461c-8cbd-83e59f3f3c0f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852123 Nov 23 10:19:24.715021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 138/286] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:19:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 10:19:24.718209 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-042f7576-bbb2-4ea8-acfb-f12ebe5e2630 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:24.720273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-042f7576-bbb2-4ea8-acfb-f12ebe5e2630 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:24.730464 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.731043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.733063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:24.733580 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:24.805621 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-042f7576-bbb2-4ea8-acfb-f12ebe5e2630 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:24.819953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-042f7576-bbb2-4ea8-acfb-f12ebe5e2630 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1218 microversion: 2.1 time: 0.107489 Nov 23 10:19:24.821295 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 139/287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:24 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:24.994664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:24.995819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:25.004112 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.004506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.005302 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.005759 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.006749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:25.025179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7d4cd67-e556-465f-ba0d-6a59705a8200 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1318 microversion: 2.1 time: 0.359148 Nov 23 10:19:25.026160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 149/288] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:24 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:25.173092 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:25.174077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:25.183336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.183938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.184875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.185314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.211803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:25.222027 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abc3a05d-ffd8-4668-bf89-6131d9f9767b tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1496 microversion: 2.1 time: 0.232953 Nov 23 10:19:25.234266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 140/289] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:24 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1496 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:25.302199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ae18afe-565d-484d-9bde-9a6bd3ac5212 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 24572 microversion: 2.20 time: 0.133660 Nov 23 10:19:25.303627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 150/290] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:25 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 24572 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:25.583338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:25.583957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:25.597138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.597588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.598416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.598858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.801881 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:25.814862 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5b3da1be-cbe4-4668-a0d1-d74c9d98e667 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.235551 Nov 23 10:19:25.815858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 141/291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:25 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:25.841307 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:25.842046 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:25.850749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.851257 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.851994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:25.852439 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:25.932321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:25.948264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98d8eefc-2368-47a7-9bc8-ee81545765c6 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1270 microversion: 2.1 time: 0.112087 Nov 23 10:19:25.949075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 151/292] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:25 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:26.048644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:26.049865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.058861 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.065795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.068945 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.069600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.086205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:26.086710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.092765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.093213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.094075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.094488 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.152512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:19:26.309316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34dc98cc-bf54-4b90-8fd6-399a34bbee0c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 204 len: 0 microversion: 2.1 time: 0.226557 Nov 23 10:19:26.310002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 152/293] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:19:26 2021] DELETE /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:19:26.319941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:26.321546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:26.327451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.332811 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13c4c8e3-1290-4b72-bf9e-2e3ac6f440f2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1508 microversion: 2.1 time: 0.288516 Nov 23 10:19:26.336103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.337044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.338050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.338803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.354179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 142/294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:26 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:26.364034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:26.364951 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.373461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.374713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.376656 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.377879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.506661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e568c2fa-605d-448f-910c-94a42c10841d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 25241 microversion: 2.20 time: 0.195022 Nov 23 10:19:26.507917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 153/295] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:26 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 25241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:26.516004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cd79cc7-45f9-4d1b-aab9-79fb3b8df689"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:26.521174 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.552783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.553243 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.554638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.555074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.751409 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Invalid volume: volume 8cd79cc7-45f9-4d1b-aab9-79fb3b8df689 is already attached to instances: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba Nov 23 10:19:26.754481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 400 to user: Invalid volume: volume 8cd79cc7-45f9-4d1b-aab9-79fb3b8df689 is already attached to instances: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:26.755894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:26.757050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd21ffa2-a75c-4c10-8b38-0e5efada5747 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.245782 Nov 23 10:19:26.765956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81e575cd-1049-4b43-a68a-e56d1f2cda9c tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1502 microversion: 2.1 time: 0.409152 Nov 23 10:19:26.766771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 154/296] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:19:26 2021] POST /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234/os-volume_attachments => generated 174 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:19:26.768469 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 143/297] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:26 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1502 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:26.838643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:26.838643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.846469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.846469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.846469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.846469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.924705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:26.925446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:26.937866 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.939837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:26.939837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:26.939837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.109280 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:27.119136 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60d3d8d7-7c27-425d-a31a-ea28ea452ac9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.290543 Nov 23 10:19:27.120145 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 155/298] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:26 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:27.125199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:27.125949 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:27.135471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.136308 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.137352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.138082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.159436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lazy-loading 'services' on Instance uuid 06a2f89c-cd1e-472b-bc51-568cf7ef32ba {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:19:27.215138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:27.223532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d402681-a0e0-4ed3-ad07-ce53d8fd2570 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1276 microversion: 2.1 time: 0.102192 Nov 23 10:19:27.224498 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 156/299] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:27 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:27.312493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-82085948-0044-44fb-a8a2-d845fe48d1d8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments/8cd79cc7-45f9-4d1b-aab9-79fb3b8df689" status: 202 len: 0 microversion: 2.1 time: 0.390961 Nov 23 10:19:27.321276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 144/300] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:19:26 2021] DELETE /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments/8cd79cc7-45f9-4d1b-aab9-79fb3b8df689 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:27.330256 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:27.334020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:27.347494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.362033 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.366908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.368218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.425127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5fa301b-bde5-4a7b-8b96-47cedb280bab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101497 Nov 23 10:19:27.432096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 157/301] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:19:27 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:19:27.520057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:27.524495 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:27.534279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.534995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.536018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.536466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.668288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a3ddf761-5e5b-4924-92f9-0d166b24cdf9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 25865 microversion: 2.20 time: 0.152239 Nov 23 10:19:27.668953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 145/302] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:27 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 25865 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:27.785369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:27.786132 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:27.797183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.797829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:27.799197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:27.799954 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.091834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:28.102230 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a135e3bf-8a75-4853-939f-31fb5380b01a tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1502 microversion: 2.1 time: 0.320966 Nov 23 10:19:28.113039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 158/303] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:27 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1502 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:28.144413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:28.144996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:28.165370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.167880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.171247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.173452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.255518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:28.256418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:28.263582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.264334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.265134 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.265567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.499735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:28.512677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e01ed05-cdd9-44d3-a3c5-3f422bad9eb0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.260798 Nov 23 10:19:28.513940 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 159/304] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:28 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:28.530058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:28.535500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:28.540702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:28.546059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.547245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.548887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.550064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.554752 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e808739-d817-4fb1-aaa9-00eb321268d5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.416620 Nov 23 10:19:28.555980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 146/305] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:28 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:28.601749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-42ad5a24-46fa-4826-97f1-45bb30e939a6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085160 Nov 23 10:19:28.602715 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 160/306] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:19:28 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:28.696554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:28.698200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:28.736067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.743123 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.745760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:28.747025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:28.994106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42bd4eff-8b6f-4f6b-a3b8-d08883440eea tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 26356 microversion: 2.20 time: 0.315973 Nov 23 10:19:28.995119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 147/307] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:28 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 26356 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:29.128500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:29.130290 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:29.142359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.143086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.144187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.144848 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.296100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-724c5d36-0bcd-4f24-9898-ea599b9c9e22 req-e71ff203-64c1-4a46-a987-1d1c1d5f7636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b664c6-48d1-489a-a36e-ae8c20da60f4", "tag": "d09d4e6d-59f4-4161-b0d7-e3ec159f8b08"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:29.302974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:29.302974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:29.336616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-724c5d36-0bcd-4f24-9898-ea599b9c9e22 req-e71ff203-64c1-4a46-a987-1d1c1d5f7636 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.338658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-724c5d36-0bcd-4f24-9898-ea599b9c9e22 req-e71ff203-64c1-4a46-a987-1d1c1d5f7636 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.389882 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-724c5d36-0bcd-4f24-9898-ea599b9c9e22 req-e71ff203-64c1-4a46-a987-1d1c1d5f7636 service nova] Creating event network-changed:d09d4e6d-59f4-4161-b0d7-e3ec159f8b08 for instance c4b664c6-48d1-489a-a36e-ae8c20da60f4 on hv-cinder-80403 Nov 23 10:19:29.399698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-724c5d36-0bcd-4f24-9898-ea599b9c9e22 req-e71ff203-64c1-4a46-a987-1d1c1d5f7636 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109624 Nov 23 10:19:29.407332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 148/308] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:19:29.544069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:29.544756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:29.545466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:29.555711 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c05ac52-2cbb-42e3-bbad-9812eada22c3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1502 microversion: 2.1 time: 0.435697 Nov 23 10:19:29.557290 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 161/309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:29 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:29.576529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:29.577159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:29.589137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.589887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.590457 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.591466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.592377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.593208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.597621 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.600832 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.939685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:29.951103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0aa03dd2-7d9b-4eab-8911-16872a05d1a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.414180 Nov 23 10:19:29.952440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 149/310] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:29 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:29.957782 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:29.959049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:29.979614 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.980551 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:29.982566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:29.985043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.030693 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:30.049551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-079b6d7f-3e93-49c4-9c99-f8670c35423c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.481129 Nov 23 10:19:30.052081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-565e7afb-c98b-40d4-9173-ecb8f85a516d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096220 Nov 23 10:19:30.053795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 150/311] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:19:29 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:19:30.062403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 162/312] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:29 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:30.075753 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:30.082804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:30.105060 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.111766 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.113065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.117731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.272778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cbbad31-a37b-4f86-8be2-8cbec4be7c56 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 26872 microversion: 2.20 time: 0.216541 Nov 23 10:19:30.277777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 151/313] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:30 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 26872 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:30.326083 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-cf750af4-c7ce-4722-941f-846d94355bc6 req-b9f076d3-cd1f-4002-ad9e-00f832dad392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e51201-88ce-4b2a-9594-8c6b9e3ca125", "name": "network-vif-deleted", "tag": "3d742cf1-b635-439b-89de-1f9a2543671a"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:30.328144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:30.328144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:30.339079 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-cf750af4-c7ce-4722-941f-846d94355bc6 req-b9f076d3-cd1f-4002-ad9e-00f832dad392 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.340113 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-cf750af4-c7ce-4722-941f-846d94355bc6 req-b9f076d3-cd1f-4002-ad9e-00f832dad392 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.354360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-cf750af4-c7ce-4722-941f-846d94355bc6 req-b9f076d3-cd1f-4002-ad9e-00f832dad392 service nova] Creating event network-vif-deleted:3d742cf1-b635-439b-89de-1f9a2543671a for instance 29e51201-88ce-4b2a-9594-8c6b9e3ca125 on hv-cinder-80403 Nov 23 10:19:30.361186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-cf750af4-c7ce-4722-941f-846d94355bc6 req-b9f076d3-cd1f-4002-ad9e-00f832dad392 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038226 Nov 23 10:19:30.367757 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 163/314] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:30.412648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1030274734", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "150b1dc7-2c30-4519-9eae-363eef258738"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:30.533510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] validate_networks() for [('150b1dc7-2c30-4519-9eae-363eef258738', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:19:30.596567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:30.598077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:30.613794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.614845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.616370 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.617183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.701129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:30.702478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:30.703731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lazy-loading 'fault' on Instance uuid 29e51201-88ce-4b2a-9594-8c6b9e3ca125 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:19:30.808790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:30.831732 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8de7aa2-2bdd-4ad6-8d96-315a7f4ed41d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 200 len: 1303 microversion: 2.1 time: 0.239996 Nov 23 10:19:30.836598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 164/315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:30 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:30.975865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:30.980413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:31.003155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.004339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.006496 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.008098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.242424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:31.256082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-edded8c2-c665-45be-afd9-b3631bd503c7 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.290483 Nov 23 10:19:31.263530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 165/316] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:30 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:31.297499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:31.298409 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:31.313173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.314971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.317191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.318270 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.517929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:31.527879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aec3e231-a222-48f0-aef2-4c7ad5f9d862 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.240192 Nov 23 10:19:31.539285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 166/317] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:31 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:31.544600 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:31.545604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:31.553734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.554493 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.556030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.557290 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.636958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:19:31.637465 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:19:31.637843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:19:31.638244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:19:31.638645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:19:31.651365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.651805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.652603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.653028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.675844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:19:31.680962 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for user 4a87253271364cf6a2052015801aa0d4 and project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:19:31.683236 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d53dbf15-1bac-42cb-8036-41ad0ee3f239 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 27463 microversion: 2.20 time: 0.141983 Nov 23 10:19:31.683890 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 167/318] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:31 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 27463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:31.693009 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:19:31.696187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:19:31.764884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b549625-a86d-40f2-8c87-28b0f20ae6c4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357919 Nov 23 10:19:31.771090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 152/319] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:19:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:19:31.778081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c5ddc224-bc18-4d97-ad47-6e893a58f204 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:31.778797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c5ddc224-bc18-4d97-ad47-6e893a58f204 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:31.857907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c5ddc224-bc18-4d97-ad47-6e893a58f204 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:31.860341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:31.860341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 29e51201-88ce-4b2a-9594-8c6b9e3ca125] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:31.872871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.873989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.875305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:31.875938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:31.876617 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c5ddc224-bc18-4d97-ad47-6e893a58f204 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1218 microversion: 2.1 time: 0.101579 Nov 23 10:19:31.878043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 168/320] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:31 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:31.898426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] HTTP exception thrown: Instance 29e51201-88ce-4b2a-9594-8c6b9e3ca125 could not be found. Nov 23 10:19:31.899264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Returning 404 to user: Instance 29e51201-88ce-4b2a-9594-8c6b9e3ca125 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:31.900076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a3726e91-6b13-437b-83a6-1060182e627d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125" status: 404 len: 111 microversion: 2.1 time: 0.052255 Nov 23 10:19:31.900770 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 153/321] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:31 2021] GET /compute/v2.1/servers/29e51201-88ce-4b2a-9594-8c6b9e3ca125 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:32.066549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-85181168", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "18a0b218-f324-427b-8941-da18a1690065"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:32.140251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] validate_networks() for [('18a0b218-f324-427b-8941-da18a1690065', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:19:32.283000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:32.283737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:32.297572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.301845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.303800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.303997 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.584991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:32.596570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b042823-18ac-4579-a293-32b24357ff59 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.317627 Nov 23 10:19:32.598375 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 154/322] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:32 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:32.614186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:32.615109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:32.627970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.629208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.631618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.632433 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.907060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:19:32.908109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:19:32.908825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:19:32.909579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:19:32.910224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:19:32.931219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.931660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.932699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:32.933130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:32.964414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Getting quotas for project 01f57ee10da3422a84977846a2d0df01. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:19:32.971103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Getting quotas for user f6196c40f4b84ec39130b4be0af585b5 and project 01f57ee10da3422a84977846a2d0df01. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:19:32.984677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:32.996333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1c97220-9170-4df4-b1e7-59a9092db929 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.394604 Nov 23 10:19:32.996997 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 155/323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:32 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:33.015600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:33.017447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:33.025089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.025611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:33.026416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.027062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:33.029631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:19:33.035162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:19:33.146077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7c26c8a3-9891-4491-bd68-5f3c16d39c06 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088169 Nov 23 10:19:33.146451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26c44773-1e72-4808-9e48-df7c3b743fa1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 27747 microversion: 2.20 time: 0.144658 Nov 23 10:19:33.147358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 156/324] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:32 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 27747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:33.155781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 169/325] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:19:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 10:19:33.157161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:33.158030 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:33.164108 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9941870d-4858-462d-b98b-76c28e4d9cc3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:33.165604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9941870d-4858-462d-b98b-76c28e4d9cc3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:33.184544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.190519 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:33.191597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.192943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:33.267395 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9941870d-4858-462d-b98b-76c28e4d9cc3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:33.290685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9941870d-4858-462d-b98b-76c28e4d9cc3 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1212 microversion: 2.1 time: 0.132972 Nov 23 10:19:33.291643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 170/326] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:33 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1212 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:33.312883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:33.329067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d34260b-232e-4506-a73b-09dde713feae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1270 microversion: 2.1 time: 0.178751 Nov 23 10:19:33.343211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 157/327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:33 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:33.617117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:33.617794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:33.639940 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.640558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:33.644977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:33.645465 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.020914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:34.023448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:34.045371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.045937 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.047133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.047691 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.094603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:34.110306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e019283-85c5-4d99-a1d2-f09d73b8bf2b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.494367 Nov 23 10:19:34.111532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 171/328] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:33 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:34.162560 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:34.163706 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:34.187909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.192138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.201380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.201380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.358707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1374c573-0a84-4d48-a73e-b5728639d62a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 27919 microversion: 2.20 time: 0.201053 Nov 23 10:19:34.361002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 172/329] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:34 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 27919 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:34.371903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:34.373404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:34.390751 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.392039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.396396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.397917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.505683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:34.522631 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd91684b-6324-47fd-9e24-5bce0676c136 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.508866 Nov 23 10:19:34.523398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 158/330] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:34 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:34.532436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:34.533637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:34.546474 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.546837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.547849 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:34.548073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:34.553119 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:34.565086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fc88ba6-8b9d-48b1-80f7-cf9717b824d2 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1264 microversion: 2.1 time: 0.202041 Nov 23 10:19:34.566012 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 173/331] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:34 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:34.676346 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:34.698760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f2780a9a-af76-44ce-8bd8-24a533d2cad9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1276 microversion: 2.1 time: 0.174157 Nov 23 10:19:34.714569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 159/332] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:34 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:35.134368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:35.138134 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:35.154510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.155050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.163449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.163957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.374260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:35.375133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:35.387451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.387901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.388699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.393908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.561434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75e8fb49-7d14-4c89-b9f0-5f34b6126f33 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28238 microversion: 2.20 time: 0.192635 Nov 23 10:19:35.562486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 160/333] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:35 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:35.581524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:35.582272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:35.602028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.602864 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.603896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:35.604610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:35.991607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:36.009944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17e8a214-5a18-451b-bcf8-b7428e31a46b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.884656 Nov 23 10:19:36.016011 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 174/334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:35 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:36.028529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:36.029151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:36.037107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.038292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.039234 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.040140 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.087538 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:36.097298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0526719-a40e-4b90-a51d-1d20b073b946 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.532996 Nov 23 10:19:36.110108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 161/335] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:35 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:36.117200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:36.118408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:36.125351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.125825 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.126876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.127309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.199243 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:36.210448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-818a5d38-a6ae-4736-b224-c433f37246c8 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1270 microversion: 2.1 time: 0.192351 Nov 23 10:19:36.212312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 175/336] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:36 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:36.410392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:36.421364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9da91ef9-1ce6-43c1-a014-2f313c8fa481 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.309782 Nov 23 10:19:36.422690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 162/337] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:36 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:36.590237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:36.592381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:36.607025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.608815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.610271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.611175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.680909 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a72eea11-e2e4-4186-a901-5c17f866f3ec req-d700ba3a-c75c-4b2f-b1b4-f18be5aac513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce5c27d-d565-4560-87b5-6d47b60bd458", "tag": "cc262c12-8cbc-492d-a17a-93e387895c04"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:36.683680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:36.683680 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:36.707537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a72eea11-e2e4-4186-a901-5c17f866f3ec req-d700ba3a-c75c-4b2f-b1b4-f18be5aac513 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:36.708007 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a72eea11-e2e4-4186-a901-5c17f866f3ec req-d700ba3a-c75c-4b2f-b1b4-f18be5aac513 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:36.728010 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a72eea11-e2e4-4186-a901-5c17f866f3ec req-d700ba3a-c75c-4b2f-b1b4-f18be5aac513 service nova] Creating event network-changed:cc262c12-8cbc-492d-a17a-93e387895c04 for instance 5ce5c27d-d565-4560-87b5-6d47b60bd458 on hv-cinder-80403 Nov 23 10:19:36.734749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a72eea11-e2e4-4186-a901-5c17f866f3ec req-d700ba3a-c75c-4b2f-b1b4-f18be5aac513 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067753 Nov 23 10:19:36.737413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 163/338] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:36.757259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aae6a02e-2cae-465b-b115-0b8e7c1a1a4b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28238 microversion: 2.20 time: 0.183283 Nov 23 10:19:36.759233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 176/339] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:36 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:37.037899 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:37.039539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:37.055444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.056005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.056922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.058844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.120139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:37.122046 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:37.144120 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.148182 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.155969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.156972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.473716 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:37.482420 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4f67e903-2090-4e96-9902-7df81f7dd486 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.452842 Nov 23 10:19:37.483004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 164/340] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:37 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:37.486783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:37.498615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b3e2375e-3b08-49d8-b065-7c053179ade7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.383320 Nov 23 10:19:37.499516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 177/341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:37 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:37.502266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-33533a2f-82fe-41b0-b427-f9fcb1b1bb99 req-70d689d2-4640-4273-b694-1d9e7120fbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b664c6-48d1-489a-a36e-ae8c20da60f4", "name": "network-vif-plugged", "status": "completed", "tag": "d09d4e6d-59f4-4161-b0d7-e3ec159f8b08"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:37.504044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:37.504044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:37.505950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:37.507933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:37.513427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-33533a2f-82fe-41b0-b427-f9fcb1b1bb99 req-70d689d2-4640-4273-b694-1d9e7120fbfd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.514201 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-33533a2f-82fe-41b0-b427-f9fcb1b1bb99 req-70d689d2-4640-4273-b694-1d9e7120fbfd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.521931 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.522427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.523232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.523672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.531772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-33533a2f-82fe-41b0-b427-f9fcb1b1bb99 req-70d689d2-4640-4273-b694-1d9e7120fbfd service nova] Creating event network-vif-plugged:d09d4e6d-59f4-4161-b0d7-e3ec159f8b08 for instance c4b664c6-48d1-489a-a36e-ae8c20da60f4 on hv-cinder-80403 Nov 23 10:19:37.547876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-33533a2f-82fe-41b0-b427-f9fcb1b1bb99 req-70d689d2-4640-4273-b694-1d9e7120fbfd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049347 Nov 23 10:19:37.556434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 165/342] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:37.564461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:37.565505 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:37.573744 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.574860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.576008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.576644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.807574 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:37.815775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ac309e8-9ff1-4e5c-bfe1-6dd56ce3da8f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.257999 Nov 23 10:19:37.816364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 166/343] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:37 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:37.823614 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:37.833978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:37.844092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.845805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.847441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:37.848261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:37.897083 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:37.905344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d58d595-e071-4e0d-9676-d6f26d06ca94 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.404719 Nov 23 10:19:37.911029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 178/344] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:37 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:37.961452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ecb466cd-4080-4eb8-924c-8e5ef60906cb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28238 microversion: 2.20 time: 0.142299 Nov 23 10:19:37.968189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 167/345] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:37 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:38.117831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-488bdfed-8a66-4f68-931e-db0ddd9a3f82 req-42b851e0-5aaf-4e34-83f2-2903647b1e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6ee072-3df6-4797-8587-c49215d891e0", "tag": "1836eeb9-7657-4bf2-81f5-f66bebc5bb56"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:38.121413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:38.121413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:38.133221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-488bdfed-8a66-4f68-931e-db0ddd9a3f82 req-42b851e0-5aaf-4e34-83f2-2903647b1e4c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.133817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-488bdfed-8a66-4f68-931e-db0ddd9a3f82 req-42b851e0-5aaf-4e34-83f2-2903647b1e4c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.149460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-488bdfed-8a66-4f68-931e-db0ddd9a3f82 req-42b851e0-5aaf-4e34-83f2-2903647b1e4c service nova] Creating event network-changed:1836eeb9-7657-4bf2-81f5-f66bebc5bb56 for instance 6b6ee072-3df6-4797-8587-c49215d891e0 on hv-cinder-80403 Nov 23 10:19:38.155701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-488bdfed-8a66-4f68-931e-db0ddd9a3f82 req-42b851e0-5aaf-4e34-83f2-2903647b1e4c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050791 Nov 23 10:19:38.156416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 179/346] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:38.502995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:38.503962 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:38.516385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:38.517852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:38.527273 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.528132 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.529204 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.529914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.532605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.533062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.533945 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.534383 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.793248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:38.802803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4259cec-2073-4cf2-a978-ffa639c25ab4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.305402 Nov 23 10:19:38.804377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 168/347] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:38 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:38.834347 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:38.835278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:38.841731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.842468 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.843962 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.844611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.872812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:38.880402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ece3daf-1418-42a5-b5ab-b1641b837ff9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.368352 Nov 23 10:19:38.890603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 180/348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:38 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:38.929321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:38.930080 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:38.941431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.941909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:38.942942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:38.943378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.177983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:39.187802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4966f844-15ec-45f2-8c5e-7591342649c5 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.263955 Nov 23 10:19:39.199337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 181/349] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:38 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:39.204950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:39.206324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:39.219544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:39.224264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.224780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.226235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.230356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-86140204-4cf8-449e-b13c-1a0c6333ec64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.401721 Nov 23 10:19:39.231749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 169/350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:38 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:39.234856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.343100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-413da70d-7239-45fa-b215-79fa5f51bc5b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28525 microversion: 2.20 time: 0.141915 Nov 23 10:19:39.343909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 182/351] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:39 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28525 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:39.821194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:39.822032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:39.828641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.829057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.832786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.833120 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.900131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:39.901117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:39.917316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.920086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:39.921096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:39.922184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.115663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:40.125061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7135db03-0b92-4a9e-b1f5-1dfd01862eb2 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1318 microversion: 2.1 time: 0.308331 Nov 23 10:19:40.126140 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 170/352] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:39 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:40.226100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:40.226100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:40.236564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.236944 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.237774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.238214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.240346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:40.269037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d8b2a838-98d6-498f-a6c2-fda2017247b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.374522 Nov 23 10:19:40.274756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 183/353] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:39 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:40.288403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:40.290763 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:40.308944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.311121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.312096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.313879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.532843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:40.541060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b5e43f5-ad7c-4185-a86b-232cac183bc9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.264174 Nov 23 10:19:40.541729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 184/354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:40 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:40.558519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:40.559729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:40.566668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.567113 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.567935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:40.568990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:40.610449 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:40.621515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-faec4ea4-3fed-4f77-bf80-55d15dca918d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.419183 Nov 23 10:19:40.624492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 171/355] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:40 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:40.893452 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcea2f3b-7a3f-4c53-a314-3322cbcd1f74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28525 microversion: 2.20 time: 0.340070 Nov 23 10:19:40.898489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 185/356] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:40 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:41.143399 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:41.144650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:41.154089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.154934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.155959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.156628 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.305024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:41.305746 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:41.315999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.316710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.317727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.318535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.377468 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:41.390363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad3d8638-6e04-428a-a1d9-6721ea02f8cf tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1506 microversion: 2.1 time: 0.250513 Nov 23 10:19:41.390956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 172/357] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:41 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:41.501605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:41.510269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-254533c0-7db2-4713-809a-7f44f9f2620d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1520 microversion: 2.1 time: 0.217291 Nov 23 10:19:41.511186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 186/358] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:41 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:41.560397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:41.561099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:41.568122 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.569127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.570345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.571061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.640179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:41.640799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:41.651953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.652659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.654437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.654872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.776705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:41.788699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b06745f6-1c43-43c4-81a3-236e7768df2e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.232988 Nov 23 10:19:41.789965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 173/359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:41 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:41.888364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:41.899227 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2c2ca5ad-f050-4825-b724-dccb276bf2e4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.262418 Nov 23 10:19:41.899867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 187/360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:41 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:41.906311 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:41.907679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:41.915700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.916443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:41.917498 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:41.918450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.035758 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-50756538-1b01-4fa1-b569-7ff3a4f10380 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.133387 Nov 23 10:19:42.036445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 174/361] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:41 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:42.526850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:42.527730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:42.542254 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.548650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.550084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.550536 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.722837 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:42.732393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-591ffe8d-b4d1-45e1-ac7b-aea502fbe3b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1500 microversion: 2.1 time: 0.208741 Nov 23 10:19:42.745468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 188/362] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:42 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:42.751065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:42.753456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:42.762066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.762510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.763936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.764446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.824760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:42.825139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:42.837454 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.837936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.838718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.839146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.932856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:42.941297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ab5678a-404e-433e-979d-58a69fb5a0ec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1514 microversion: 2.1 time: 0.194549 Nov 23 10:19:42.942466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 175/363] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:42 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:42.948848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:42.949460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:42.957126 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.957967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:42.959016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:42.960270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:43.023157 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:43.031569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-008ab4ea-64df-41aa-9fea-ab953c855198 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.224264 Nov 23 10:19:43.036100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 189/364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:42 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:43.055471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:43.055471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:43.060328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:43.061098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:43.064512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:43.066623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:43.171658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:43.174969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3307683a-b6d8-4c6d-880f-2d64e81ab24b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.126796 Nov 23 10:19:43.175785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 190/365] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:43 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:43.188591 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a00f08c1-5cb5-42b6-98bb-6a17f14b6d27 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.244808 Nov 23 10:19:43.189846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 176/366] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:42 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:44.054521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:44.055778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:44.064019 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.064473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.065312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.065668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.187355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:44.188888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:44.201301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.202025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.203002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.203593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.210467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:44.221321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8038c0a-710b-4ce9-bef4-33508bc99f4e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.170740 Nov 23 10:19:44.222397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 191/367] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:44 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:44.227169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:44.228590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:44.235249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.235995 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.237032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.237589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.294811 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dee7d449-4cef-4a31-9d6a-54dd1c66388d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.111181 Nov 23 10:19:44.295798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 177/368] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:44 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:44.381045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:44.388807 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb2aa200-0b13-4ea5-b549-35e82a3ef0f7 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.165244 Nov 23 10:19:44.389570 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 192/369] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:44 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:44.481642 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:44.482685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:44.489514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.489990 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.490797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.491229 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.514554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lazy-loading 'flavor' on Instance uuid afe7ef11-1dd1-496b-b4d6-de2f5505c8dc {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:19:44.648307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a0e79b38-07fa-4b23-b262-9fa357f81355 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action" status: 200 len: 32 microversion: 2.1 time: 0.170797 Nov 23 10:19:44.653435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 178/370] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:19:44 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:19:44.657933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:44.658591 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:44.666276 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.667349 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.668351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:44.668879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:44.816127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:44.829879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a021d640-4cbf-4382-8e44-4b0a35aaf03e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.175708 Nov 23 10:19:44.843463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 193/371] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:44 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:45.063061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-8c50da2b-f7c6-4638-b4d9-066218b98936 req-3e2a0061-2465-4654-90f4-5b78e42cb6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce5c27d-d565-4560-87b5-6d47b60bd458", "name": "network-vif-plugged", "status": "completed", "tag": "cc262c12-8cbc-492d-a17a-93e387895c04"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:45.064604 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:45.064604 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:45.073196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8c50da2b-f7c6-4638-b4d9-066218b98936 req-3e2a0061-2465-4654-90f4-5b78e42cb6ed service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.074017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8c50da2b-f7c6-4638-b4d9-066218b98936 req-3e2a0061-2465-4654-90f4-5b78e42cb6ed service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.086943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-8c50da2b-f7c6-4638-b4d9-066218b98936 req-3e2a0061-2465-4654-90f4-5b78e42cb6ed service nova] Creating event network-vif-plugged:cc262c12-8cbc-492d-a17a-93e387895c04 for instance 5ce5c27d-d565-4560-87b5-6d47b60bd458 on hv-cinder-80403 Nov 23 10:19:45.092566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-8c50da2b-f7c6-4638-b4d9-066218b98936 req-3e2a0061-2465-4654-90f4-5b78e42cb6ed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Nov 23 10:19:45.093761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 179/372] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:45.243983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:45.244706 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:45.260771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.261231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.268521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.268996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.309852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:45.310843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:45.328729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.334711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.335068 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.335516 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.478294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7641dcfd-45bc-437c-8d57-002181022c5e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.173544 Nov 23 10:19:45.493725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 180/373] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:45 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:45.510375 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:45.511256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:45.527483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.529349 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.531375 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.532586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.614835 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:45.623210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a02ca0f-5409-41df-8f6f-a0c65438b419 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.385504 Nov 23 10:19:45.624468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 194/374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:45 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:45.729442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:45.737007 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e08031a-00f8-4b56-8531-fe6fad00024d tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.240870 Nov 23 10:19:45.738109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 181/375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:45 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:45.859851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:45.860513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:45.866405 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.866876 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:45.867626 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:45.868058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.002629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:46.011131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-586263fb-0b4c-4c0d-8bf3-69145fad7a5c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.154896 Nov 23 10:19:46.020643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 195/376] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:45 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:46.542207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:46.543529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:46.551117 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.551560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.552378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.553177 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.640326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:46.641771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:46.644720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0e057d9-530f-4b56-bf1f-7aa6edd08d38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.108771 Nov 23 10:19:46.645434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 182/377] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:46 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:46.652908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.653634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.654457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.655051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.756916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:46.757683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:46.769025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.769487 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.770348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:46.770790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:46.813677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:46.822930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8051a8ba-f164-4cc7-a14b-a2c7ea90ddea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.186169 Nov 23 10:19:46.823556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 196/378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:46 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:46.915402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:46.922696 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9459ef37-daea-46fe-bca0-4cb24d8a7759 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.170881 Nov 23 10:19:46.923353 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 183/379] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:46 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:47.028135 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:47.028781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:47.034535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.034982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.035759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.036191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.126157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-f578025d-9a09-4088-a299-7e2bc31bf8d1 req-2f372069-ad16-4a9f-a3c9-55ca101935c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6ee072-3df6-4797-8587-c49215d891e0", "name": "network-vif-plugged", "status": "completed", "tag": "1836eeb9-7657-4bf2-81f5-f66bebc5bb56"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:47.128165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:47.128165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:19:47.136620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f578025d-9a09-4088-a299-7e2bc31bf8d1 req-2f372069-ad16-4a9f-a3c9-55ca101935c9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.137214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f578025d-9a09-4088-a299-7e2bc31bf8d1 req-2f372069-ad16-4a9f-a3c9-55ca101935c9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.149636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-f578025d-9a09-4088-a299-7e2bc31bf8d1 req-2f372069-ad16-4a9f-a3c9-55ca101935c9 service nova] Creating event network-vif-plugged:1836eeb9-7657-4bf2-81f5-f66bebc5bb56 for instance 6b6ee072-3df6-4797-8587-c49215d891e0 on hv-cinder-80403 Nov 23 10:19:47.154628 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-f578025d-9a09-4088-a299-7e2bc31bf8d1 req-2f372069-ad16-4a9f-a3c9-55ca101935c9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Nov 23 10:19:47.155710 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 184/380] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:19:47.176568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:47.185048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fdff1d7-67ff-43d8-a7d0-55ac2ec314de tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.160592 Nov 23 10:19:47.185821 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 197/381] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:47 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:47.657276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:47.658418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:47.667670 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.668144 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.669241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.669871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.832792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9f888f2-47b4-474b-a14f-d62c762329b2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.179849 Nov 23 10:19:47.838375 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 185/382] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:47 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:47.843827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:47.844970 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:47.852636 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.853071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.854061 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.854637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.951867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:47.952931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:47.962043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.962485 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:47.963258 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:47.963852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:48.054869 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:48.073464 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ed15d8b-4f72-4714-ab9f-0203a71f60f4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1318 microversion: 2.1 time: 0.236698 Nov 23 10:19:48.075184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 198/383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:47 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:48.126983 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:48.138837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-adc780dd-1cf7-4227-a31a-70fe9e400e8f tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.195973 Nov 23 10:19:48.139720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 186/384] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:47 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:48.202522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:48.203119 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:48.210657 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:48.211256 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:48.212124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:48.212624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:48.382208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:48.391250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f1b3581-50eb-4b90-86f6-1115131f54b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.192725 Nov 23 10:19:48.391973 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 199/385] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:48 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:48.848430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:48.849555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:48.856631 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:48.857414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:48.858606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:48.859424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:48.956542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42a837e0-26f5-41dd-aae3-b92956876ca7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.111439 Nov 23 10:19:48.957540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 187/386] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:48 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:49.093422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:49.094087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:49.101480 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.102736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.102736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.103163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.157125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:49.157881 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:49.170836 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.171787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.172910 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.173562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.266717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:49.274049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b10364f5-8482-478f-80e0-be4c7554437b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1508 microversion: 2.1 time: 0.184186 Nov 23 10:19:49.278535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 200/387] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:49 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:49.409384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:49.410262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:49.424618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.425365 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.426402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.429123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.440729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:49.453815 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ddf8773c-59b5-4e8f-a47a-b3bfc1ad4abf tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1312 microversion: 2.1 time: 0.300726 Nov 23 10:19:49.467588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 188/388] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:49 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:49.680448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:49.689684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-26bd52f2-0d80-40f1-b94f-a7689cb00559 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.283957 Nov 23 10:19:49.690679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 201/389] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:49 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:19:49.968495 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:49.970057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:49.978393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.978950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:49.979839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:49.980370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.071568 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-37a75a14-b2d8-40e8-9c1c-63f62d2ad6a6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 28690 microversion: 2.20 time: 0.106882 Nov 23 10:19:50.072262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 189/390] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:49 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 28690 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:50.476676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:50.477281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:50.483318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.483765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.484640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.485066 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.635084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:50.642922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2db00e04-412c-4e0d-aa48-f5f6975cd7db tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1496 microversion: 2.1 time: 0.170470 Nov 23 10:19:50.643490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 202/391] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:50 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:50.707734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:50.708429 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:50.717394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.718257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.719383 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.719824 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.770748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76b90b6-32dd-45da-97d5-a29d1819f373"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:50.772631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:50.778534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.779010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.779798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:50.780232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:50.864608 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:50.873265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8fc7bbde-14fe-482b-bbab-f9c8c2b06ccf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.169350 Nov 23 10:19:50.873819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 190/392] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:50 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:51.079834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ebbdfdd6-593f-4e95-b3d7-2f5ab5fbf275 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312784 Nov 23 10:19:51.080834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 203/393] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:19:50 2021] POST /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:19:51.090291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:51.092632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:51.111742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.112567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.117080 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.118490 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.270844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-19fc634c-4df8-420e-800e-721f2e270995 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 29547 microversion: 2.20 time: 0.190379 Nov 23 10:19:51.271777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 191/394] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:51 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 29547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:51.420974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:51.422130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:51.431004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.431445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.432232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.432665 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.457364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:19:51.533176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3a75274-450a-4a7b-a986-c7d25d9a80b4 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 204 len: 0 microversion: 2.1 time: 0.122914 Nov 23 10:19:51.534056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 204/395] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:19:51 2021] DELETE /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:19:51.544043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:51.544973 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:51.552278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.552721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.554243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.554712 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.693875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:51.701343 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38ee6c34-5046-4f54-993d-1350b9f51aa0 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1502 microversion: 2.1 time: 0.162365 Nov 23 10:19:51.702043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 192/396] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:51 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:51.893157 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:51.893892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:51.900987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.901438 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:51.902259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:51.902697 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:52.039099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:52.047479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78a7191c-2242-449f-8544-d4ce1306af9b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.158591 Nov 23 10:19:52.048071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 205/397] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:51 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:52.281847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:52.282902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:52.290253 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:52.290983 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:52.292030 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:52.292650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:52.414746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-653e9c33-c0f0-4a00-b7d5-7f4590d56e88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 30189 microversion: 2.20 time: 0.136305 Nov 23 10:19:52.418852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 193/398] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:52 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 30189 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:52.718524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:52.719127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:52.725354 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:52.725831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:52.726607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:52.727038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:52.884191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:52.891503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-423be9c0-91f6-4576-bd14-1024fdc25550 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1502 microversion: 2.1 time: 0.176782 Nov 23 10:19:52.892075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 206/399] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:52 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:53.065796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:53.066502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:53.073297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.073779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:53.074558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.074994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:53.427395 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:53.429153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:53.437714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.438681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:53.439494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.439922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:53.447443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:53.458678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-889a9d32-7804-4a14-8701-41d56e785325 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.397260 Nov 23 10:19:53.459547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 194/400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:53 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:53.559595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ecd57f81-c6e6-47c5-a791-793927304acc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 31263 microversion: 2.20 time: 0.135781 Nov 23 10:19:53.560266 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 207/401] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:53 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 31263 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:53.908836 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:53.910184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:53.921203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.922057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:53.923124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:53.923747 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:54.089393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:54.099795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-06ae3c2c-5485-421c-a97a-e324d2642d41 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1502 microversion: 2.1 time: 0.195162 Nov 23 10:19:54.100417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 195/402] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:53 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:54.478515 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:54.479294 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:54.488303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:54.488937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:54.489872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:54.490841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:54.572886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:54.574544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:54.581463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:54.582133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:54.583090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:54.583698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:54.642324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:54.649684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d2771f4-5d28-4cec-92e6-b50d9e6cd61b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.177170 Nov 23 10:19:54.650298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 208/403] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:54 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:54.704432 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad17f587-99ce-4631-84dc-d70fde225453 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 34511 microversion: 2.20 time: 0.136117 Nov 23 10:19:54.706105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 196/404] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:54 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 34511 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:55.073067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-3764c29b-0f95-4325-b001-5bcb7dc575e8 req-942e911f-038a-4b59-9a09-fe6712538941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6ee072-3df6-4797-8587-c49215d891e0", "name": "network-vif-deleted", "tag": "1836eeb9-7657-4bf2-81f5-f66bebc5bb56"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:55.075247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:19:55.075247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:19:55.083828 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3764c29b-0f95-4325-b001-5bcb7dc575e8 req-942e911f-038a-4b59-9a09-fe6712538941 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.084380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3764c29b-0f95-4325-b001-5bcb7dc575e8 req-942e911f-038a-4b59-9a09-fe6712538941 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.097765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-3764c29b-0f95-4325-b001-5bcb7dc575e8 req-942e911f-038a-4b59-9a09-fe6712538941 service nova] Creating event network-vif-deleted:1836eeb9-7657-4bf2-81f5-f66bebc5bb56 for instance 6b6ee072-3df6-4797-8587-c49215d891e0 on hv-cinder-80403 Nov 23 10:19:55.103974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-3764c29b-0f95-4325-b001-5bcb7dc575e8 req-942e911f-038a-4b59-9a09-fe6712538941 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Nov 23 10:19:55.105288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 209/405] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:19:55.127234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:55.128395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:55.140618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.141512 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.142434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.143661 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.217911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6196c40f4b84ec39130b4be0af585b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f57ee10da3422a84977846a2d0df01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:55.227122 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc8e6f2c-3263-4711-98e3-328f7f9f2995 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 200 len: 1297 microversion: 2.1 time: 0.105500 Nov 23 10:19:55.227690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 197/406] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:55 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:55.668398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:55.669099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:55.676716 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.677197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.678874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.679614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.716520 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:55.718081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:55.725284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.726023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.726819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:55.727453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:55.843761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-10ed57df-fef6-4da9-96c6-7e7caca46194 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 34979 microversion: 2.20 time: 0.129799 Nov 23 10:19:55.845182 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 198/407] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:55 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 34979 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:19:55.854375 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:55.863664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d46581f1-bffc-4fd7-80c4-94ec858549cb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.199840 Nov 23 10:19:55.864453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 210/408] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:55 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:56.245536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:56.246262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] [instance: 6b6ee072-3df6-4797-8587-c49215d891e0] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:56.252989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.253430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:56.254218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.254641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:56.276975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] HTTP exception thrown: Instance 6b6ee072-3df6-4797-8587-c49215d891e0 could not be found. Nov 23 10:19:56.277784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] Returning 404 to user: Instance 6b6ee072-3df6-4797-8587-c49215d891e0 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:19:56.278971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d803935e-33d6-44e1-b282-d56ae3d2a157 tempest-VolumesActionsTest-54881371 tempest-VolumesActionsTest-54881371-project] 10.222.0.41 "GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0" status: 404 len: 111 microversion: 2.1 time: 0.037273 Nov 23 10:19:56.279701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 199/409] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:56 2021] GET /compute/v2.1/servers/6b6ee072-3df6-4797-8587-c49215d891e0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:19:56.857845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:56.859031 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:56.866087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.866620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:56.867531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.868012 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:56.883234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:56.894129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:56.911035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.911489 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:56.913986 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:56.915077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:57.130707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0f54ba0b-1dc1-427b-972d-a110586e0224 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 35878 microversion: 2.20 time: 0.276208 Nov 23 10:19:57.131641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 211/410] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:56 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 35878 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:19:57.167055 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:57.175176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a99d7d57-36d6-4076-9917-7b6102175584 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.297146 Nov 23 10:19:57.175932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 200/411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:56 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:58.145533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:19:58.147300 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:58.154267 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:58.154707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:58.155490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:58.155959 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:58.194252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:58.194868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:58.202194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:58.202708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:58.203778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:58.204282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:58.364605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:58.372026 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-28ba9ae3-5c71-486d-bd5a-ab0bdc1f4451 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.182425 Nov 23 10:19:58.372621 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 201/412] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:58 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:19:59.390111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:19:59.390722 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:19:59.397595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:59.398063 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:59.398910 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:19:59.399261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:19:59.565180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:19:59.575076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8e88a03-f218-4b97-a98e-2bcaaa3baa24 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.188554 Nov 23 10:19:59.576039 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 202/413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:19:59 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:00.592683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:00.593347 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:00.601573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:00.602257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:00.603048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:00.603492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:00.738359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:00.747478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dd4aa897-5ed9-45ad-a792-dacb6b67f6a8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.158252 Nov 23 10:20:00.748394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 203/414] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:00 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:00.922184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-24f11023-494e-4bc7-b7c9-98ea8b4f84bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 37154 microversion: 2.20 time: 2.781432 Nov 23 10:20:00.923143 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 212/415] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:19:58 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 37154 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:01.759193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76b90b6-32dd-45da-97d5-a29d1819f373"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:01.760111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:01.764623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:01.765302 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:01.766525 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.766972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:01.767745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.768174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:01.773263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.773733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:01.774522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.774956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:01.860277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Invalid volume: volume e76b90b6-32dd-45da-97d5-a29d1819f373 is already attached to instances: 5ce5c27d-d565-4560-87b5-6d47b60bd458 Nov 23 10:20:01.860963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 400 to user: Invalid volume: volume e76b90b6-32dd-45da-97d5-a29d1819f373 is already attached to instances: 5ce5c27d-d565-4560-87b5-6d47b60bd458 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:20:01.865736 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-092bc17b-9d0b-4c9b-82c9-8d8fbd6947ae tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106864 Nov 23 10:20:01.866476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 204/416] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:20:01 2021] POST /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:20:01.892732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1704564902", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:01.925602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:01.934520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4ee11fc4-4780-4596-bd93-16fc73351d48 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.173919 Nov 23 10:20:01.935456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 213/417] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:01 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:01.940447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:01.941456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:01.946064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] validate_networks() for None {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:20:01.948068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.948583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:01.949436 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:01.950018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.044913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55fb6430-5303-48d9-9728-96a08353a96a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 37578 microversion: 2.20 time: 0.108009 Nov 23 10:20:02.048937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 214/418] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:01 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 37578 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:02.051004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:02.051692 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:02.058966 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.059508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.060303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.060797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.194592 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lazy-loading 'services' on Instance uuid 5ce5c27d-d565-4560-87b5-6d47b60bd458 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:02.336933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7ba0e25-4a60-490d-997e-20e614ee1d7c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments/e76b90b6-32dd-45da-97d5-a29d1819f373" status: 202 len: 0 microversion: 2.1 time: 0.289804 Nov 23 10:20:02.337873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 215/419] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:20:02 2021] DELETE /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments/e76b90b6-32dd-45da-97d5-a29d1819f373 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:02.352275 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:02.354389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:02.364087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.364720 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.365956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.366460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.412997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66aa7737-976c-4d2e-9420-2328eea96c64 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070159 Nov 23 10:20:02.413810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 216/420] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:02 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:02.420409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:20:02.421162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:20:02.421483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:20:02.422125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:20:02.422605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:20:02.433911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.434717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.435918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.436364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.459715 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Getting quotas for project d8aea9a0abe2454ea035a6b70874c53b. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:20:02.464173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Getting quotas for user 222f877d7e804b31be645f1aac01242b and project d8aea9a0abe2454ea035a6b70874c53b. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:20:02.478956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:20:02.481641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:20:02.538397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55c0c10b-0f15-4378-8ca5-1463b45dab12 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649171 Nov 23 10:20:02.539664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 205/421] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:20:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 10:20:02.549029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8901f313-0e88-43da-919b-f7ed6f37d47f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:02.549914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8901f313-0e88-43da-919b-f7ed6f37d47f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:02.621508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8901f313-0e88-43da-919b-f7ed6f37d47f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:02.629741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8901f313-0e88-43da-919b-f7ed6f37d47f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1215 microversion: 2.1 time: 0.084285 Nov 23 10:20:02.630871 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 217/422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:02 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:02.953257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:02.953903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:02.961167 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.961620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:02.962477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:02.962917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.057377 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:03.062592 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:03.075642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.078570 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.079925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.080521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.120420 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:03.129795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1d9bc97-299c-433a-bcb8-754a390c5e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.180521 Nov 23 10:20:03.142005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 206/423] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:02 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:03.218983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74c0e619-d02f-420b-8e09-7fa8adb89314 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 37884 microversion: 2.20 time: 0.166138 Nov 23 10:20:03.219935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 218/424] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:03 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 37884 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:03.425812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:03.426887 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:03.432996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.433444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.434252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.435025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.477306 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a362b196-b289-4663-bb14-9ad9f3e409cc tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055209 Nov 23 10:20:03.478104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 207/425] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:03 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:03.648298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:03.649002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:03.656002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.656483 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.657276 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:03.657727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:03.720232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:03.729721 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ddb417a-2774-48b2-b7f6-75fff6d8bbd6 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1267 microversion: 2.1 time: 0.086016 Nov 23 10:20:03.730630 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 219/426] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:03 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:04.150737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:04.151447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:04.158203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.158975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.159829 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.160479 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.231882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:04.233435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:04.244566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.245312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.246920 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.247446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.384345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b11c81f7-92c1-41d1-8033-16453f01dc39 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38103 microversion: 2.20 time: 0.154440 Nov 23 10:20:04.385191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 220/427] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:04 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38103 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:04.489877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:04.491495 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:04.499867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.500594 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.501825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.502440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.510290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:04.524023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4c353496-1d1d-40ec-977e-a1a63017d472 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.377443 Nov 23 10:20:04.535632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 208/428] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:04 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:04.546731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-52ccf542-cec0-45b3-a9bf-77a7371bf340 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061674 Nov 23 10:20:04.547304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 221/429] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:04 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:20:04.735390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-779708532", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "150b1dc7-2c30-4519-9eae-363eef258738"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:04.749449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:04.750078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:04.757937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.758589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:04.759848 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:04.760564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.032644 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:05.046946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55afd424-aeeb-4dbe-9c8d-8ccf4819fe1d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.302339 Nov 23 10:20:05.048218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 222/430] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:04 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:05.397125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:05.398558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:05.405093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:05.405854 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.406896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:05.407700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.506666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aee8d002-0b37-452f-8350-87c7d4676d17 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38103 microversion: 2.20 time: 0.112947 Nov 23 10:20:05.507803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 223/431] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:05 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38103 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:05.551847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:05.553577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:05.578286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:05.580137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.581253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:05.582138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.767972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:05.780318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00bfe54e-04b8-4a1d-b140-fa5484ae3e4f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.239475 Nov 23 10:20:05.791645 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 224/432] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:05 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:05.812734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-70553695-9a39-4ff4-851d-bdf5b914b553 req-62ea7c94-16b6-420e-bad7-b4b462d25e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5060c1a1-3464-4d8e-b14a-f47c7061c94a", "tag": "8a004a00-195c-4198-9885-657ec3b0cd07"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:05.814917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:05.814917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:20:05.826492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-70553695-9a39-4ff4-851d-bdf5b914b553 req-62ea7c94-16b6-420e-bad7-b4b462d25e7a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:05.827232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-70553695-9a39-4ff4-851d-bdf5b914b553 req-62ea7c94-16b6-420e-bad7-b4b462d25e7a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:05.845196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-70553695-9a39-4ff4-851d-bdf5b914b553 req-62ea7c94-16b6-420e-bad7-b4b462d25e7a service nova] Creating event network-changed:8a004a00-195c-4198-9885-657ec3b0cd07 for instance 5060c1a1-3464-4d8e-b14a-f47c7061c94a on hv-cinder-80403 Nov 23 10:20:05.851092 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-70553695-9a39-4ff4-851d-bdf5b914b553 req-62ea7c94-16b6-420e-bad7-b4b462d25e7a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042183 Nov 23 10:20:05.852009 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 225/433] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:20:06.066034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:06.066979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:06.074279 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.075289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.076398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.077004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.148279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] validate_networks() for [('150b1dc7-2c30-4519-9eae-363eef258738', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:20:06.263500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:06.273808 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b34538d3-f79e-482a-acd6-d235b90342b8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.211761 Nov 23 10:20:06.275036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 226/434] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:06 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:06.519858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:06.523503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:06.534370 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.534822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.535621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.536058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.735859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccad332e-b1aa-4bc6-9ef4-b589573c9680 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38103 microversion: 2.20 time: 0.220272 Nov 23 10:20:06.736518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 227/435] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:06 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38103 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:06.775785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:20:06.776254 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:20:06.777146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:20:06.777786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:20:06.778198 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:20:06.790218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.790960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.794476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.795220 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.798969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:06.799666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:06.807101 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.807789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.808584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:06.809040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:06.819690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:20:06.830915 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Getting quotas for user 4a87253271364cf6a2052015801aa0d4 and project 3d3b011b5c1240f2838d04766f5a1fbf. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:20:06.846885 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:20:06.851031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:20:06.916225 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aee26c5a-472a-4fdf-b139-38060ab4c352 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184822 Nov 23 10:20:06.916475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 209/436] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:20:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:20:06.933841 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1847205a-706c-4348-ba18-6776339258dd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:06.935661 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1847205a-706c-4348-ba18-6776339258dd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:07.001988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:07.012037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97e3ce0c-0f0a-4df5-971a-dde6788f24b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.217029 Nov 23 10:20:07.012909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 228/437] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:06 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:07.045591 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1847205a-706c-4348-ba18-6776339258dd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:07.054809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1847205a-706c-4348-ba18-6776339258dd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1217 microversion: 2.1 time: 0.131425 Nov 23 10:20:07.064540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 210/438] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:06 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:07.292919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:07.293626 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:07.302375 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:07.302803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:07.303607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:07.304045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:07.463028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:07.470735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6743f718-13e3-4113-9058-e177cabf0066 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.181792 Nov 23 10:20:07.471313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 229/439] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:07 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:07.747829 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:07.748798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:07.755232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:07.755697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:07.756470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:07.756901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:07.864491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4d6350be-fb5e-4c9f-89be-160e44498eb7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38103 microversion: 2.20 time: 0.120533 Nov 23 10:20:07.865358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 211/440] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:07 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38103 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:08.048859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:08.050458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:08.076785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:08.078293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:08.082337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.084868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.088104 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.095291 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.110941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.113272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.115805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.118760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.195270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:08.208164 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81342646-33ae-4fd6-82e9-9794e819bdb5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1269 microversion: 2.1 time: 0.136932 Nov 23 10:20:08.218430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 212/441] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:08 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:08.280728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:08.288039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1dab06d2-489b-42f5-ac37-3bfb80742353 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.250005 Nov 23 10:20:08.288819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 230/442] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:08 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:08.486668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:08.487453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:08.497313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.502132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.503314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.503855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.876322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:08.877235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:08.885125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.885874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.886850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:08.887482 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:08.926847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:08.935341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81e53138-64fa-4011-bfa1-e39564c170e8 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.452275 Nov 23 10:20:08.945798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 213/443] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:08 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:09.004557 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d2ea664-9394-42b8-b08d-a585b3f4f0dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38184 microversion: 2.20 time: 0.131690 Nov 23 10:20:09.005852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 231/444] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:08 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38184 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:09.226800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:09.227896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:09.234463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.235340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:09.236342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.236772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:09.327586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:09.329217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:09.338241 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.339075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:09.340137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.340784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:09.444859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:09.463666 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8e8934e6-3f55-4a3b-b1a9-f799854119aa tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1275 microversion: 2.1 time: 0.240899 Nov 23 10:20:09.479157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 214/445] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:09 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:09.611600 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:09.624128 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-169c2866-6a49-4100-824c-f5970129a0ff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.314731 Nov 23 10:20:09.625504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 232/446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:09 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:09.955218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:09.957300 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:09.963856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.965016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:09.966215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:09.967093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.017665 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:10.018933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:10.025627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.030116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.030878 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.031323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.157965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1231e48e-f2f9-44b1-adb3-ea3e5dca97d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 200 len: 38246 microversion: 2.20 time: 0.144490 Nov 23 10:20:10.159285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 233/447] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:10 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 38246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:10.169676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:10.171175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:10.186655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.187880 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.189544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.190326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.225846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3720bb66-d1c0-4e06-832f-50c18eae69b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/ips" status: 200 len: 151 microversion: 2.20 time: 0.059919 Nov 23 10:20:10.232432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 234/448] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 23 10:20:10 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:20:10.249776 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:10.261136 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8bcef4de-ad38-4b1d-b2f8-ab7e259e3ef7 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.311748 Nov 23 10:20:10.271174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 215/449] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:09 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:10.487205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:10.490642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:10.502959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e5f22041-e382-4184-88a2-93256c337daa req-741dce90-4661-48ef-9d20-63cdb0a7d2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764e4b24-16f3-403b-8f3d-07a305a17d95", "tag": "b4f65d2f-364c-4f14-b762-d90b7afb1b38"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:10.505062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:10.505062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:20:10.516473 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e5f22041-e382-4184-88a2-93256c337daa req-741dce90-4661-48ef-9d20-63cdb0a7d2a8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.517022 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e5f22041-e382-4184-88a2-93256c337daa req-741dce90-4661-48ef-9d20-63cdb0a7d2a8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.520282 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.525618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.527419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.532093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.556424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e5f22041-e382-4184-88a2-93256c337daa req-741dce90-4661-48ef-9d20-63cdb0a7d2a8 service nova] Creating event network-changed:b4f65d2f-364c-4f14-b762-d90b7afb1b38 for instance 764e4b24-16f3-403b-8f3d-07a305a17d95 on hv-cinder-80403 Nov 23 10:20:10.572331 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e5f22041-e382-4184-88a2-93256c337daa req-741dce90-4661-48ef-9d20-63cdb0a7d2a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073180 Nov 23 10:20:10.573561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 216/450] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:10.642772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:10.643471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:10.650734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.651193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.651989 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:10.657965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:10.754685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:10.763242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8eaf6c7-830a-472a-9ae5-1839fe3afe1b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.283998 Nov 23 10:20:10.763829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 235/451] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:10 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:11.023280 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:11.031821 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75923542-3d74-4c7f-8946-d6b7793d2aff tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.393149 Nov 23 10:20:11.032647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 217/452] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:10 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:11.278397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:11.279087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:11.285269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:11.285769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:11.287058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:11.287683 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:11.466528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:11.475569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84d81a9b-753c-47b2-a325-793c4e486729 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.199965 Nov 23 10:20:11.488513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 236/453] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:11 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:11.783561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:11.785235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:11.804132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:11.804586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:11.805378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:11.809106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:11.997255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:12.005157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3bd6befd-ab58-4368-ad77-0b1bde54a990 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.228019 Nov 23 10:20:12.006247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 218/454] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:11 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:12.049993 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:12.050889 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:12.058056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:12.058743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:12.059545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:12.060037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:12.213187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:12.222755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30e66edd-7dc1-46c1-b133-f70dfea3faad tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.174781 Nov 23 10:20:12.232730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 237/455] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:12 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:12.491963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:12.492753 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:12.498831 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:12.499279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:12.500054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:12.500488 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:12.648471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:12.660886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9a8a65c-b84e-43ee-aba7-18a2bd344b7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.171508 Nov 23 10:20:12.687214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 219/456] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:12 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:13.024207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:13.024859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:13.032432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.032879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.033677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.034139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.175963 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:13.183603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b20901e4-9ad1-4ac3-8e96-b7fee3d5e7db tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.163534 Nov 23 10:20:13.184178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 238/457] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:13 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:13.240948 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:13.241848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:13.248396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.249113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.249932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.250365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.401654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:13.411954 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-292e199e-816e-4906-b0f0-7f132078f57b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.174915 Nov 23 10:20:13.423975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 220/458] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:13 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:13.612796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:13.613392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:13.620528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.621193 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.622190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.622915 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.648314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lazy-loading 'flavor' on Instance uuid b6188ff0-e2b2-4465-a6c9-68b77464d49e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:13.691622 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:13.694101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:13.713404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.722306 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.724535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:13.725570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:13.933992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:13.964348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3acf68e7-c907-4490-b53d-6b5ee674d013 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.267287 Nov 23 10:20:13.974636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 221/459] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:13 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:14.104205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d12a92f-42a6-4e8f-aad1-933d7e6237b7", "device": "/dev/sdb"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:14.106311 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:14.116880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.117303 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.123344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.124265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.138663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30cdd917-af37-4c77-aba8-c979385a59e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 202 len: 0 microversion: 2.20 time: 0.526091 Nov 23 10:20:14.139728 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 239/460] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:20:13 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:20:14.148834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:14.154861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:14.167805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.169063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.170180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.172666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.382069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:14.391504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:14.393396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:14.394729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f066fdd0-2841-40ca-8dbf-16ff84db544f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.250897 Nov 23 10:20:14.395862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 240/461] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:14 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:14.401681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:14.402380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:14.410008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.411264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.413209 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.414410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.594108 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:14.601483 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-572e9754-32f0-4cdd-8ab0-ad8e31008a87 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.203655 Nov 23 10:20:14.603221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 241/462] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:14 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:14.607849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:14.608726 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:14.616764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.618442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.619723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.620708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:14.719844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61347488-24f9-4307-b7bb-d7f511025014 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "POST /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621089 Nov 23 10:20:14.721510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 222/463] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:20:14 2021] POST /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:14.835325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:14.847397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b863de43-c0bf-4712-884b-4cee957ea7b9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.242918 Nov 23 10:20:14.848157 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 242/464] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:14 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:14.988609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:14.991954 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:14.999090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:14.999633 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.000415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.001077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.176083 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:15.189996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7cf739d0-83e7-4cc6-b8bd-d218fe5da771 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.211114 Nov 23 10:20:15.200235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 223/465] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:14 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:15.419285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:15.420786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:15.429505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.435472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0d2ce440-e2d7-49fc-9c09-bab21c9db4aa req-76f3b9b8-b65c-44be-baaf-3cb7da155608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5060c1a1-3464-4d8e-b14a-f47c7061c94a", "name": "network-vif-plugged", "status": "completed", "tag": "8a004a00-195c-4198-9885-657ec3b0cd07"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:15.437464 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:15.437464 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:20:15.443235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.445782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.447997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.453217 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0d2ce440-e2d7-49fc-9c09-bab21c9db4aa req-76f3b9b8-b65c-44be-baaf-3cb7da155608 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.455203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0d2ce440-e2d7-49fc-9c09-bab21c9db4aa req-76f3b9b8-b65c-44be-baaf-3cb7da155608 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.478279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0d2ce440-e2d7-49fc-9c09-bab21c9db4aa req-76f3b9b8-b65c-44be-baaf-3cb7da155608 service nova] Creating event network-vif-plugged:8a004a00-195c-4198-9885-657ec3b0cd07 for instance 5060c1a1-3464-4d8e-b14a-f47c7061c94a on hv-cinder-80403 Nov 23 10:20:15.483802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0d2ce440-e2d7-49fc-9c09-bab21c9db4aa req-76f3b9b8-b65c-44be-baaf-3cb7da155608 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051976 Nov 23 10:20:15.484997 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 224/466] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:15.626268 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:15.628889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:15.642265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.643259 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.647318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.648090 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.655403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:15.672221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:15.673731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:15.674890 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fb35359-dd82-49e7-9a28-c772a82365f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.259994 Nov 23 10:20:15.675759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 243/467] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:15 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:15.867685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:15.868285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:15.884618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.885877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.887123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:15.887572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:15.974599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:15.992116 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c88836c9-b113-4c3f-a9ff-9ae1ac65fa1a tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.374806 Nov 23 10:20:15.993085 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 225/468] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:15 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:16.053059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:16.061932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc6dd3f0-faab-49a9-9336-fbf9affd3cec tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.198417 Nov 23 10:20:16.062640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 244/469] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:15 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:16.206673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:16.207573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:16.214082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:16.214762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:16.215723 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:16.216333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:16.370845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:16.384025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5554f630-806c-4e32-8f69-addf38ac5020 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.180853 Nov 23 10:20:16.393803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 226/470] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:16 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:16.692755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:16.693988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:16.701055 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:16.701952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:16.703237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:16.703855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:16.850072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:16.861337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:16.863329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:16.864060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bae73146-7c49-47bf-bcc5-7368d0a5e9e3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.175323 Nov 23 10:20:16.875483 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 245/471] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:16 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:17.010689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:17.012164 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.018475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.019143 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.020138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.021605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.079175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:17.080016 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.091932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.092268 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.093076 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.093709 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.179076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:17.187077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6842d17d-30e2-4bf4-b74c-44ad04e539ab tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.180116 Nov 23 10:20:17.187659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 227/472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:17 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:17.264153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:17.272982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86950f71-1ee8-440f-8e40-1fb070ac6757 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1500 microversion: 2.1 time: 0.197460 Nov 23 10:20:17.273554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 246/473] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:17 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:17.290229 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc51f11-9bc5-4892-b9d4-5d91513159c1"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:17.291728 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.301669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.302552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.303345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.303811 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.328581 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] HTTP exception thrown: Cannot 'attach_volume' instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc while it is in vm_state rescued Nov 23 10:20:17.329171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Returning 409 to user: Cannot 'attach_volume' instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc while it is in vm_state rescued {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:20:17.331417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1700e605-d35d-4aa2-b91a-aceaa7ddc1fa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044541 Nov 23 10:20:17.331417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 228/474] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:20:17 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 10:20:17.340815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:17.341361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.347973 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.348423 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.349385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.349870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.403612 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:17.404326 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.410772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.411227 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.412057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.412499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.424674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3aca6bad-87fe-427b-87a8-630ba557df07 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.087747 Nov 23 10:20:17.426364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 247/475] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:20:17 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:20:17.435521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:17.435521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.442229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.443427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.444363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.444874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.611070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:17.620008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e030ecb4-f00a-4773-81f1-2ccef82bec7c tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1315 microversion: 2.1 time: 0.219657 Nov 23 10:20:17.621723 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 229/476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:17 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:17.629127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:17.649896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-59d03c06-f350-403d-9354-9d36d5565df6 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1508 microversion: 2.1 time: 0.218973 Nov 23 10:20:17.653907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 248/477] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:17 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:17.883542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:17.884158 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:17.890894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.891347 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:17.892133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:17.892566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.206048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:18.206786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:18.216753 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.218673 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.221663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.222269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.227287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.246351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.250221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.253452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b7207a85-0d64-4876-88d2-cf5d231271ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.373755 Nov 23 10:20:18.268013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 230/478] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:17 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:18.435883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.444552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-304d24fb-66e7-45a2-9003-f4d22fd427ca tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.242747 Nov 23 10:20:18.445379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 249/479] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:18 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:18.640895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:18.641414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:18.649735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.650435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.651400 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.651835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.671223 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:18.671872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:18.678912 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.679371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.680232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.680864 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.836827 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.838867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:18.846498 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46a623a8-cda5-4692-a19e-aecc23ee2271 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1508 microversion: 2.1 time: 0.179300 Nov 23 10:20:18.847454 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 250/480] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:18 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:18.849209 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-24f7dabb-7475-4aeb-b9ec-38e80768320d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1465 microversion: 2.1 time: 0.212395 Nov 23 10:20:18.865153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 231/481] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:18 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1465 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:18.894387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:18.895068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:18.901743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.902414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.903194 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:18.903629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:18.930045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:20:19.054873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3029262d-cd38-49f0-9807-8b6ae9ad802b tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 204 len: 0 microversion: 2.1 time: 0.165424 Nov 23 10:20:19.056640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 251/482] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:20:18 2021] DELETE /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:20:19.065507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:19.066925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:19.080445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.080901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.081896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.082463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.247563 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:19.248558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ac539158-7138-4941-b688-05c590e87119 req-dea2738e-d536-43f6-ab6c-943656c0d581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764e4b24-16f3-403b-8f3d-07a305a17d95", "name": "network-vif-plugged", "status": "completed", "tag": "b4f65d2f-364c-4f14-b762-d90b7afb1b38"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:19.250327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:19.250327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:20:19.262197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ac539158-7138-4941-b688-05c590e87119 req-dea2738e-d536-43f6-ab6c-943656c0d581 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.263416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ac539158-7138-4941-b688-05c590e87119 req-dea2738e-d536-43f6-ab6c-943656c0d581 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.263854 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f5df629-569f-44d7-b420-707705d376ad tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1471 microversion: 2.1 time: 0.202461 Nov 23 10:20:19.278195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ac539158-7138-4941-b688-05c590e87119 req-dea2738e-d536-43f6-ab6c-943656c0d581 service nova] Creating event network-vif-plugged:b4f65d2f-364c-4f14-b762-d90b7afb1b38 for instance 764e4b24-16f3-403b-8f3d-07a305a17d95 on hv-cinder-80403 Nov 23 10:20:19.279561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 232/483] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:19 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:19.293719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ac539158-7138-4941-b688-05c590e87119 req-dea2738e-d536-43f6-ab6c-943656c0d581 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052034 Nov 23 10:20:19.294476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 252/484] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:19.304294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:19.304953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:19.312154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.312362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.314131 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.315350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.463031 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:19.464034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:19.481730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.482474 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.483339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.483814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.500787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:19.530813 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:19.534445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:19.537345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-384ba5a1-2efd-4cc2-966b-295c35955eb0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.255351 Nov 23 10:20:19.542356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 233/485] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:19 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:19.661324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:19.670154 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74cb639f-da31-4706-9c36-07df343cc96b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.211919 Nov 23 10:20:19.673736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 253/486] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:19 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:19.869644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:19.870311 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:19.880386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.881012 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:19.882580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:19.883328 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.044826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.054622 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b27b9575-1d8f-4799-8177-f319683335f0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1508 microversion: 2.1 time: 0.189450 Nov 23 10:20:20.055220 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 234/487] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:19 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:20.291251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:20.291901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:20.299930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.300460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.301323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.301870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.463535 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.471178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b74b73a-063a-4506-a168-a6235d063bba tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1471 microversion: 2.1 time: 0.184523 Nov 23 10:20:20.481460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 254/488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:20 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:20.566045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:20.567141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:20.576083 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.576893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.578223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.579283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.694287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:20.695923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:20.702633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.703327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.704502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:20.705248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:20.750582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.760184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.761729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.762921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2e348778-77b0-4943-974f-801473f3632f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.202039 Nov 23 10:20:20.763847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 235/489] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:20 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:20.858090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:20.866437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36f30160-0122-4019-9e58-4feffe902dac tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.176302 Nov 23 10:20:20.867207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 255/490] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:20 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:21.073072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:21.073785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:21.079974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.080453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.081267 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.081774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.497994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:21.499452 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:21.518256 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.518574 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:21.523970 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.528040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.528605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d04cfb8-1d19-4cea-8ed0-4a204361ed03 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1508 microversion: 2.1 time: 0.459389 Nov 23 10:20:21.529796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 236/491] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:21 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:21.530435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.735757 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:21.744352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed63449e-06f6-468d-99db-53081c27497d tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1471 microversion: 2.1 time: 0.259253 Nov 23 10:20:21.753581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 256/492] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:21 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:21.780731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:21.781350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:21.789149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.789613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.790754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.791802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.884845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:21.886024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:21.892486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.893202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.894145 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:21.894683 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:21.982662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:21.992215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:21.994506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:21.995877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61f062fe-eb71-47d9-8e3b-db7f5c59036c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.219215 Nov 23 10:20:21.996804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 237/493] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:21 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:22.082868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:22.092571 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a33ff486-252d-4413-8ba9-ff97869868ba tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1317 microversion: 2.1 time: 0.212685 Nov 23 10:20:22.093581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 257/494] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:21 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:22.553047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:22.554138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:22.564047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:22.564863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:22.566211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:22.567243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:22.750959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:22.763742 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:22.764476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:22.772055 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7dc0aa1f-6b4a-48e6-bb58-219d3f499d17 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1508 microversion: 2.1 time: 0.226971 Nov 23 10:20:22.775742 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:22.776846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:22.778467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:22.779262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:22.785857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 238/495] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:22 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:23.013426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:23.013948 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:23.014541 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:23.024715 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce9c5ace-2988-45e5-9bf3-a649be423c43 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1471 microversion: 2.1 time: 0.266607 Nov 23 10:20:23.026561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 258/496] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:22 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:23.028197 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.032752 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.033955 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.034727 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.109835 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:23.110809 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:23.123133 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.124258 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.125277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.125786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.363028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:23.380620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee2cfba9-73ea-4009-bfc2-e112984a179c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1507 microversion: 2.1 time: 0.273999 Nov 23 10:20:23.381721 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 259/497] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:23 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:23.387961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:23.401208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:23.404286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:23.405638 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aef67525-d1c5-4df6-97f2-1364bc44bf2e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.396299 Nov 23 10:20:23.414204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 239/498] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:23 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:23.741782 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-27ecf5d3-5258-478e-bdb5-41e79e173fed req-0f65fbb3-4f6a-472a-895b-886e9793b7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5060c1a1-3464-4d8e-b14a-f47c7061c94a", "name": "network-vif-deleted", "tag": "8a004a00-195c-4198-9885-657ec3b0cd07"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:23.743825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:23.743825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:20:23.768136 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-27ecf5d3-5258-478e-bdb5-41e79e173fed req-0f65fbb3-4f6a-472a-895b-886e9793b7fe service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.773379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-27ecf5d3-5258-478e-bdb5-41e79e173fed req-0f65fbb3-4f6a-472a-895b-886e9793b7fe service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.793141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:23.793895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:23.819099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.819833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.820857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:23.821600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:23.824071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-27ecf5d3-5258-478e-bdb5-41e79e173fed req-0f65fbb3-4f6a-472a-895b-886e9793b7fe service nova] Creating event network-vif-deleted:8a004a00-195c-4198-9885-657ec3b0cd07 for instance 5060c1a1-3464-4d8e-b14a-f47c7061c94a on hv-cinder-80403 Nov 23 10:20:23.852611 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-27ecf5d3-5258-478e-bdb5-41e79e173fed req-0f65fbb3-4f6a-472a-895b-886e9793b7fe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124785 Nov 23 10:20:23.855315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 260/499] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:24.047040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:24.048553 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:24.060995 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.061401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.063091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.063540 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.101966 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.102411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.103039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lazy-loading 'fault' on Instance uuid 5060c1a1-3464-4d8e-b14a-f47c7061c94a {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:24.110936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:24.124032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8ce4b58-7a04-4325-afc5-d24e4d7a884e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1514 microversion: 2.1 time: 0.335878 Nov 23 10:20:24.124882 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 240/500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:23 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:24.156654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222f877d7e804b31be645f1aac01242b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aea9a0abe2454ea035a6b70874c53b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:24.166802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2fe21064-6b09-4088-9716-ccf0a4501d7f tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 200 len: 1305 microversion: 2.1 time: 0.124509 Nov 23 10:20:24.168302 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 261/501] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:24 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:24.425571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:24.426442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:24.433103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.433980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.435118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.435686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.671812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:24.680413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:24.682207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:24.683659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3b825f5-c39b-4c8d-a610-1f9f93fa73ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.262963 Nov 23 10:20:24.684804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 241/502] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:24 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:24.874921 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e2d4da3-f910-45bc-8dc4-410e625a1796"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:24.875937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:24.882383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.882830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:24.883610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:24.884043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:25.186100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:25.186857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] [instance: 5060c1a1-3464-4d8e-b14a-f47c7061c94a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:25.196152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:25.196950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:25.198356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:25.199139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:25.218041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] HTTP exception thrown: Instance 5060c1a1-3464-4d8e-b14a-f47c7061c94a could not be found. Nov 23 10:20:25.218630 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] Returning 404 to user: Instance 5060c1a1-3464-4d8e-b14a-f47c7061c94a could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:20:25.219456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca59c40d-cb64-4717-800b-d046fbdedaa9 tempest-VolumesNegativeTest-2046197357 tempest-VolumesNegativeTest-2046197357-project] 10.222.0.41 "GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a" status: 404 len: 111 microversion: 2.1 time: 0.038691 Nov 23 10:20:25.220002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 242/503] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:25 2021] GET /compute/v2.1/servers/5060c1a1-3464-4d8e-b14a-f47c7061c94a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:20:25.702984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:25.703500 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:25.709215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:25.709657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:25.710448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:25.710874 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:25.848499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:25.858418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:25.859895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:25.861040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a80ac133-2c02-4ab5-848f-8cb71f62e576 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.161970 Nov 23 10:20:25.861584 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 243/504] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:25 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:26.881960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:26.882706 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:26.890422 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:26.890867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:26.891676 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:26.892103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:27.038179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:27.046151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:27.047666 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:27.050669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3f1def08-1c59-4a11-b884-10e8c29d1843 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.171840 Nov 23 10:20:27.051651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 244/505] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:26 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:28.068856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:28.070538 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:28.077886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:28.078327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:28.079101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:28.079731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:28.206708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2366016-f329-400e-a9fc-4f1d1c80ded4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "POST /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.335375 Nov 23 10:20:28.208270 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 262/506] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:20:24 2021] POST /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 194 bytes in 3338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:28.234916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:28.245654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:28.247260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:28.248453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e4616c5-4db1-4fcc-9cd2-92cc710bd830 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.184015 Nov 23 10:20:28.249321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 245/507] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:28 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:28.861734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:28.862990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:28.870968 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:28.871512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:28.872501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:28.872991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:29.022525 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:29.031161 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8a095502-809d-40e4-86fc-805202a4ff3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1514 microversion: 2.1 time: 0.173813 Nov 23 10:20:29.031759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 263/508] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:28 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:29.059911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8983448-1228-41ba-9167-b8816a5a8973"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:29.061193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:29.068615 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:29.069068 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:29.070092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:29.070773 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:29.278041 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:29.279009 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:29.298190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:29.298638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:29.299687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:29.300129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:29.377655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-893b475b-635f-49fa-bd58-30d49211957c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331102 Nov 23 10:20:29.378393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 246/509] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:20:29 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:29.461171 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:29.469767 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:29.471281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:29.472505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2ac36c7-199f-4d5b-a275-31e93e7fb3e9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.198730 Nov 23 10:20:29.473141 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 264/510] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:29 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:30.494700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:30.494700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:30.500150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:30.500713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:30.501562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:30.502033 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:30.646504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:30.655160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:30.656705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:30.657928 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d6f278b-d275-48d4-8248-1b6190c814a9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.170682 Nov 23 10:20:30.658504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 247/511] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:30 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:31.677786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:31.678303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:31.684830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:31.685357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:31.686151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:31.686583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:31.818571 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:31.826186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:31.827679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:31.828810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57df97dc-1889-4161-86a5-56d71b7e1e26 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.155651 Nov 23 10:20:31.829393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 265/512] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:31 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:32.847445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:32.848075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:32.857191 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:32.857781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:32.858483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:32.859051 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:32.997455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:33.005814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:33.007359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:33.008531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ccc771b-56b9-432d-b727-cbed2943a1b7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.165282 Nov 23 10:20:33.009084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 248/513] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:32 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:34.026444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:34.027040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:34.033447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:34.033916 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:34.034698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:34.035124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:34.174224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:34.183201 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:34.184847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:34.186051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b69cae3-418f-4923-9385-ef1f81a82807 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.163246 Nov 23 10:20:34.186616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 266/514] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:34 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:35.204360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:35.205015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:35.212276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:35.212729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:35.213526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:35.213999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:35.376151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:35.384603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:35.386134 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:35.387365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef5b7aad-699f-4e6c-9cd3-fed01575766d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.186600 Nov 23 10:20:35.387871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 249/515] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:35 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:36.405372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:36.406020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:36.413367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:36.414094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:36.414893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:36.415325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:36.655197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:36.663366 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:36.665102 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:36.666289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e15d8044-0725-473c-bf9e-4b3f1dc13147 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.264729 Nov 23 10:20:36.666860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 267/516] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:36 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:37.685204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:37.685204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:37.694919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:37.695407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:37.696634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:37.697334 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:38.090757 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:38.099305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:38.100952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:38.102571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2376bfac-5ab2-42f9-a626-2d1710701153 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.421944 Nov 23 10:20:38.103260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 250/517] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:37 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:39.128905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:39.129576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:39.155017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.156213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.157378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.159905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.321107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:39.321637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:39.342133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.342598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.343423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.347046 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.464543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:39.478073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:39.479967 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:39.481611 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6e67bba-0e79-470e-90b2-0b4623f6be62 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.357720 Nov 23 10:20:39.495227 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 268/518] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:39 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:39.515172 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lazy-loading 'services' on Instance uuid 764e4b24-16f3-403b-8f3d-07a305a17d95 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:39.595634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-35794c3c-7da3-4f28-a817-70f277930a9b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments/0e2d4da3-f910-45bc-8dc4-410e625a1796" status: 202 len: 0 microversion: 2.1 time: 0.281304 Nov 23 10:20:39.596530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 251/519] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:20:39 2021] DELETE /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments/0e2d4da3-f910-45bc-8dc4-410e625a1796 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:39.605582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:39.607130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:39.614560 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.615048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.615860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:39.616633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:39.671739 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0a8a32d-6f03-45d2-ba8a-627a224cc6d6 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070023 Nov 23 10:20:39.672656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 269/520] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:39 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:40.506667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:40.507247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:40.523434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:40.523959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:40.524934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:40.525444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:40.684457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:40.685487 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:40.692566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:40.693023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:40.693849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:40.694277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:40.747649 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0c640b7-0ff0-4981-a851-eae42b329944 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067235 Nov 23 10:20:40.748249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 270/521] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:40 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:20:40.813677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:40.823093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:40.824448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:40.826176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ad6761c-25b5-4cb1-a1a1-fd32544c3703 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1743 microversion: 2.20 time: 0.329147 Nov 23 10:20:40.833865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 252/522] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:40 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1743 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:41.761447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:41.762546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:41.770518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:41.771011 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:41.771868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:41.772245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:41.805743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f4196a0-8234-49a7-a055-46496cfc6a3b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Nov 23 10:20:41.806645 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 271/523] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:41 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:41.846159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:41.846771 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:41.854484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:41.855224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:41.856034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:41.856465 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:41.996334 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:42.005558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:42.007135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:42.008300 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bec135f5-2423-4622-937b-a3ff715176c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1743 microversion: 2.20 time: 0.166893 Nov 23 10:20:42.009025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 253/524] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:41 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:42.442795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:42.443525 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:42.461541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:42.462045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:42.462843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:42.463281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:42.556247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lazy-loading 'services' on Instance uuid c4b664c6-48d1-489a-a36e-ae8c20da60f4 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:42.661429 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29822800-1dc3-4530-9efa-9e5060fab052 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4/os-volume_attachments/2d12a92f-42a6-4e8f-aad1-933d7e6237b7" status: 202 len: 0 microversion: 2.1 time: 0.222049 Nov 23 10:20:42.663233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 272/525] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:20:42 2021] DELETE /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4/os-volume_attachments/2d12a92f-42a6-4e8f-aad1-933d7e6237b7 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:20:42.820597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:42.822977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:42.834286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:42.835118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:42.836153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:42.837116 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:42.883481 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07707856-840d-4ee3-a5fd-5b66c95daf4b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069539 Nov 23 10:20:42.884901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 254/526] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:42 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:43.027568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:43.028597 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:43.035501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:43.036062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:43.036956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:43.037467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:43.287437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:43.307075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:43.308984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:43.310353 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b441b667-f2e1-4862-a072-36a9ba51ccf6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1743 microversion: 2.20 time: 0.286908 Nov 23 10:20:43.311426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 273/527] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:43 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:43.902761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:43.903721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:43.911863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:43.912523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:43.914269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:43.914959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:43.950613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f9b4330c-393a-4eb6-8e51-305330410393 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Nov 23 10:20:43.955165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 255/528] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:43 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:44.328515 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:44.329677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:44.337555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:44.338046 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:44.338791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:44.339817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:44.583404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:44.613678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:44.620264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:44.626382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b79900af-85a7-4200-93ab-1a7256c72785 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.301269 Nov 23 10:20:44.647526 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 274/529] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:44 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:44.861483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e19914fd-01f3-46c7-b49a-52462d00ba52 req-7976716e-e758-4a83-b852-d8b0ef575f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "name": "network-vif-plugged", "status": "completed", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:44.863126 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:44.863126 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:20:44.882107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e19914fd-01f3-46c7-b49a-52462d00ba52 req-7976716e-e758-4a83-b852-d8b0ef575f74 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:44.882974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e19914fd-01f3-46c7-b49a-52462d00ba52 req-7976716e-e758-4a83-b852-d8b0ef575f74 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:44.945968 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e19914fd-01f3-46c7-b49a-52462d00ba52 req-7976716e-e758-4a83-b852-d8b0ef575f74 service nova] Creating event network-vif-plugged:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:20:44.964399 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:44.965935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:44.976401 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e19914fd-01f3-46c7-b49a-52462d00ba52 req-7976716e-e758-4a83-b852-d8b0ef575f74 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116526 Nov 23 10:20:44.985274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 256/530] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:44.987547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:44.988188 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:44.989343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:44.990716 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:45.070297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a55cee20-2152-4ee3-8867-e62e60e0defd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103319 Nov 23 10:20:45.074266 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 275/531] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:44 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:20:45.670758 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:45.671579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:45.704537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:45.705363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:45.718892 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:45.719356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:46.084990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:46.085955 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:46.102930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:46.109861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:46.114783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:46.122357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:46.219320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00e576c2-dcdd-487d-877b-c95036d1ef0b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134337 Nov 23 10:20:46.223595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 276/532] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:46 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:20:46.236597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:46.245427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:46.253018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:46.266275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f38815b-ffdd-487f-ae74-47249cb58c8a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.602995 Nov 23 10:20:46.266781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 257/533] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:45 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:47.030569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:47.033571 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:47.045212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.046139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.047957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.048989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.136431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lazy-loading 'flavor' on Instance uuid afe7ef11-1dd1-496b-b4d6-de2f5505c8dc {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:47.231603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:47.233092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:47.250606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.252790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.294569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.295237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.356471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-efc2288e-d900-40bd-a5ef-24222010ee45 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128589 Nov 23 10:20:47.363233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 258/534] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:20:47 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:20:47.395337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90e3bda3-9464-40f4-bd05-86f3be1c972f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action" status: 200 len: 32 microversion: 2.1 time: 0.406507 Nov 23 10:20:47.398189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 277/535] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:20:46 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:20:47.401244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:47.401952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:47.428454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.428898 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.429785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.430207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.435116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:47.439321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:47.460544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.467545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.468585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:47.469156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:47.881364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:47.914135 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47f2c200-cef1-4fc4-a02b-b335d95cf4c4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.501682 Nov 23 10:20:47.930382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 278/536] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:47 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:48.859253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:48.859943 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:48.920367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:48.928776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:48.936445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:48.939911 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.040033 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:20:49.094149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:49.106647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:49.118972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:49.130740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-208e43cc-e2c9-4875-acfe-7389eed50d72 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 1.762292 Nov 23 10:20:49.131724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 259/537] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:47 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:49.136654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:49.138995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:49.152846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.153578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.155496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.185349 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.335354 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ca5d9c0-5b04-4fa4-8295-127534efe872 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 204 len: 0 microversion: 2.1 time: 0.488588 Nov 23 10:20:49.352025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 279/538] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:20:48 2021] DELETE /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:20:49.357249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:49.357979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:49.384599 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.385941 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.388092 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.389639 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.638334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:49.647397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c58c4740-08ff-4905-aab0-4c1897614005 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1513 microversion: 2.1 time: 0.294001 Nov 23 10:20:49.649555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 280/539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:49 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:49.654613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:49.655357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:49.663922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.664717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.665978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.666652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.706787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:20:49.869007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ce945f1-b272-4ce3-8bbc-8e9b70d45cd4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 204 len: 0 microversion: 2.1 time: 0.215277 Nov 23 10:20:49.872199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 281/540] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:20:49 2021] DELETE /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:20:49.885100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:49.885998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:49.892720 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.893440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.894700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:49.895369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:49.916878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:49.926995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c9a51b6d-3fe2-481b-a0c3-430415bbcd3c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.793950 Nov 23 10:20:49.927574 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 260/541] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:49 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:50.065505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:50.076839 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4bf8d8e8-7ee6-4c4e-9d4e-54393035a3f4 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1512 microversion: 2.1 time: 0.199646 Nov 23 10:20:50.080097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 282/542] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:49 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:50.154776 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:50.158141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:50.181598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.182980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:50.184018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.184956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:50.489483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:50.516576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:50.519643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:50.524539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-166e2cdc-f9da-4511-a4a4-cc5bbaf08bce tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.379041 Nov 23 10:20:50.540338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 261/543] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:50 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:50.664615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:50.665630 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:50.672747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.673197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:50.674008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.674640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:50.948880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:50.949498 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:50.966100 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.966946 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:50.968130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:50.968729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:51.056679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.071248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c2959b2-977c-4626-9d32-a62825547bf1 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1513 microversion: 2.1 time: 0.410520 Nov 23 10:20:51.074654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 283/544] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:50 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:51.236780 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.265071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0f0e4ab8-f1b1-42e9-9a91-c2e98105b9d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.321755 Nov 23 10:20:51.275025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 262/545] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:50 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:51.287156 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:51.287156 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:51.299775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:51.300263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:51.302516 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:51.304028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:51.380992 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Action: 'create', calling method: .version_select at 0x7f9fd76d1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1268409533"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:51.411889 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:20:51.416771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for user a72ae5b8eb4d47f48e174c90e5398860 and project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:20:51.599374 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.608376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2024b92a-9310-4d44-80de-db9660e16d6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1512 microversion: 2.1 time: 0.340282 Nov 23 10:20:51.609735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 263/546] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:51 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:51.615603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:51.616471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:51.632011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:51.632805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:51.633847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:51.634514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:51.804470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.813459 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.815072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:51.816353 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-015141d3-ab53-4bf8-bcff-781b0eff54c2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.205377 Nov 23 10:20:51.827952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 264/547] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:51 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:51.830800 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:20:51.835740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for user a72ae5b8eb4d47f48e174c90e5398860 and project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:20:51.853676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab809778-2449-481d-ba61-f3ac2b8d816d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.777175 Nov 23 10:20:51.854493 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 284/548] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 23 10:20:51 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:52.093308 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:52.094466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:52.108970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.109840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.110924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.112427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.294404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:52.295585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:52.307704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.309371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.312105 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.313780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.452376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:52.464014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4482cffb-2547-4d7c-84cf-bf3f0915c3b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1513 microversion: 2.1 time: 0.376192 Nov 23 10:20:52.467235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 265/549] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:52 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1513 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:52.627237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:52.627858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:52.645282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.645747 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.659698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.663955 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.918503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:52.934620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-777deba2-1beb-4f61-bff0-217240336a53 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.651253 Nov 23 10:20:52.935691 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 285/550] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:52 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:52.954937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:52.959438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:52.960433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:52.971784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1052031-523b-40a1-932a-d1fc6cfa364c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1512 microversion: 2.1 time: 0.348179 Nov 23 10:20:52.972775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 266/551] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:52 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:52.973911 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.982907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:52.987216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:52.989776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.320926 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-dbcff7cb-68ae-4ad2-ab1d-10de71768272 req-9176c48a-8dbe-4481-8b6b-eabaf47c9c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764e4b24-16f3-403b-8f3d-07a305a17d95", "name": "network-vif-deleted", "tag": "b4f65d2f-364c-4f14-b762-d90b7afb1b38"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:53.324596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:53.324596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:20:53.385245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-dbcff7cb-68ae-4ad2-ab1d-10de71768272 req-9176c48a-8dbe-4481-8b6b-eabaf47c9c36 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.386607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-dbcff7cb-68ae-4ad2-ab1d-10de71768272 req-9176c48a-8dbe-4481-8b6b-eabaf47c9c36 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.402729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:53.412795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:53.414574 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:53.419064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8cfb4015-b073-438e-afba-9626424957b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.482060 Nov 23 10:20:53.420485 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-dbcff7cb-68ae-4ad2-ab1d-10de71768272 req-9176c48a-8dbe-4481-8b6b-eabaf47c9c36 service nova] Creating event network-vif-deleted:b4f65d2f-364c-4f14-b762-d90b7afb1b38 for instance 764e4b24-16f3-403b-8f3d-07a305a17d95 on hv-cinder-80403 Nov 23 10:20:53.420892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 286/552] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:52 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:53.435615 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-dbcff7cb-68ae-4ad2-ab1d-10de71768272 req-9176c48a-8dbe-4481-8b6b-eabaf47c9c36 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119111 Nov 23 10:20:53.440440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 267/553] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:53.483671 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:53.484631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:53.496659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.497437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.498455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.507586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.682814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.684997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.686168 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lazy-loading 'fault' on Instance uuid 764e4b24-16f3-403b-8f3d-07a305a17d95 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:53.792062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:53.811159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-85bc8018-a4cc-43f0-b7a0-fcddc0e4a431 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 200 len: 1307 microversion: 2.1 time: 0.328422 Nov 23 10:20:53.812415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 287/554] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:53 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:53.955454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:53.963627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:53.987668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.988219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:53.994254 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:53.995240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:53.996172 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:53.996764 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.005265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.008658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.010721 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.011297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.135616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:54.153404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46906d80-a3bb-4fdb-a2e4-6dd96681e5ff tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1470 microversion: 2.1 time: 0.165770 Nov 23 10:20:54.154351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 288/555] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:53 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:54.296621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-6a58bc10-ee98-4b43-88eb-1181fb82d4f8 req-08f8a55d-b9e4-4658-9abc-d8a255175f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b664c6-48d1-489a-a36e-ae8c20da60f4", "name": "network-vif-deleted", "tag": "d09d4e6d-59f4-4161-b0d7-e3ec159f8b08"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:20:54.298152 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:20:54.298152 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:20:54.311121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6a58bc10-ee98-4b43-88eb-1181fb82d4f8 req-08f8a55d-b9e4-4658-9abc-d8a255175f8d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.313534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6a58bc10-ee98-4b43-88eb-1181fb82d4f8 req-08f8a55d-b9e4-4658-9abc-d8a255175f8d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.346022 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-6a58bc10-ee98-4b43-88eb-1181fb82d4f8 req-08f8a55d-b9e4-4658-9abc-d8a255175f8d service nova] Creating event network-vif-deleted:d09d4e6d-59f4-4161-b0d7-e3ec159f8b08 for instance c4b664c6-48d1-489a-a36e-ae8c20da60f4 on hv-cinder-80403 Nov 23 10:20:54.359544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-6a58bc10-ee98-4b43-88eb-1181fb82d4f8 req-08f8a55d-b9e4-4658-9abc-d8a255175f8d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066332 Nov 23 10:20:54.363643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 289/556] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:20:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:20:54.367499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:54.383773 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-176e369f-ffa9-4e41-aee0-a3692c8d194c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.425849 Nov 23 10:20:54.384804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 268/557] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:53 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:54.439672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:54.440944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:54.448250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.448990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.449981 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.450574 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.679313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:54.689472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:54.691038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:54.692300 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e868a05-d98c-4783-981a-a9c4d1484f38 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.257423 Nov 23 10:20:54.693126 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 290/558] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:54 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:54.828682 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:54.830165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 764e4b24-16f3-403b-8f3d-07a305a17d95] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:54.852405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.852775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.853798 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:54.854421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:54.870396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Instance 764e4b24-16f3-403b-8f3d-07a305a17d95 could not be found. Nov 23 10:20:54.871243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 404 to user: Instance 764e4b24-16f3-403b-8f3d-07a305a17d95 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:20:54.872256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fefc2e88-e682-4766-8ec0-06e54f516e5f tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95" status: 404 len: 111 microversion: 2.1 time: 0.047261 Nov 23 10:20:54.873343 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 269/559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:54 2021] GET /compute/v2.1/servers/764e4b24-16f3-403b-8f3d-07a305a17d95 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:20:55.172808 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:55.174198 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:55.196516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.198424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.201813 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.202693 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.307013 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.307462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.307919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lazy-loading 'fault' on Instance uuid c4b664c6-48d1-489a-a36e-ae8c20da60f4 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:20:55.402073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:55.402835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:55.404342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:55.414681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.417117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad53a887-6f33-4014-9037-eea51ef8f2fc tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 200 len: 1308 microversion: 2.1 time: 0.248658 Nov 23 10:20:55.418610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.419749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 291/560] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:55 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:55.420943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.423434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.613428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:55.623937 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d566c6a-3401-40f7-9613-e1e65f7856fe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.226829 Nov 23 10:20:55.624737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 270/561] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:55 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:20:55.710186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:55.710796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:55.718586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.719068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.719919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:55.720677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:55.894090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:55.904985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:55.906745 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:55.907819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-049aa983-4336-4486-8a7e-39b09d4ec347 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.201896 Nov 23 10:20:55.908811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 292/562] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:55 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:56.087125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:56.088281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:56.095810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.097081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.099006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.099919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.127781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:20:56.254844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5976763e-024f-477e-85fd-02a2dd8f76d4 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 204 len: 0 microversion: 2.1 time: 0.168823 Nov 23 10:20:56.256179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 271/563] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:20:56 2021] DELETE /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:20:56.265082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:56.266275 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:56.294311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.294505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.295244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.295672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.436395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:56.437015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c4b664c6-48d1-489a-a36e-ae8c20da60f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:56.447049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.447832 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.448866 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.449367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.476800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] HTTP exception thrown: Instance c4b664c6-48d1-489a-a36e-ae8c20da60f4 could not be found. Nov 23 10:20:56.477782 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Returning 404 to user: Instance c4b664c6-48d1-489a-a36e-ae8c20da60f4 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:20:56.478899 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4afd3c01-eec5-4ba5-8790-4210c7a5adf8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4" status: 404 len: 111 microversion: 2.1 time: 0.047139 Nov 23 10:20:56.480067 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 272/564] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:56 2021] GET /compute/v2.1/servers/c4b664c6-48d1-489a-a36e-ae8c20da60f4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:20:56.576817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:56.589159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1b90ff3-48ea-43b2-ab3e-3b09eda4fd59 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1514 microversion: 2.1 time: 0.328371 Nov 23 10:20:56.602097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 293/565] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:56 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:56.641624 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:56.642255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:56.653386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.653868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.654786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.655469 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.883809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:56.899690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9774ce3e-708f-4388-87bd-ec5c894fa382 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.261293 Nov 23 10:20:56.911629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 273/566] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:56 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:56.927737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:56.928348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:56.934761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.935202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:56.936004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:56.936432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:57.114389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:57.122893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:57.124396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:57.128606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c76ee792-57da-4b59-8ab0-c74410c1ea6d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.205236 Nov 23 10:20:57.134085 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 294/567] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:56 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:20:57.611721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:57.613177 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:57.628394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:57.629971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:57.630996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:57.631420 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:57.781683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:57.795477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd91d20b-c11f-4d9d-856d-bdcc221321fd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1514 microversion: 2.1 time: 0.191109 Nov 23 10:20:57.798111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 274/568] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:57 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:57.919817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:57.921097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:57.937214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:57.938019 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:57.939801 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:57.940338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:58.122073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:58.137035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f31e78d1-bbce-48d9-ba1b-933b28b53c9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.221428 Nov 23 10:20:58.150365 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 295/569] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:57 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:58.154428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:58.155282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:58.164970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:58.165649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:58.167011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:58.167644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:58.339009 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:58.352629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:58.355816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:58.356922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b85ceb6a-8eb1-46f2-96ea-57ac8f4a1cf8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.209490 Nov 23 10:20:58.368698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 275/570] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:58 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:20:58.819007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:58.819609 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:58.826497 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:58.827062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:58.827957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:58.828550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:58.985740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:58.996220 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2040b856-5217-40ca-bdf9-981aba4d2efb tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1514 microversion: 2.1 time: 0.181566 Nov 23 10:20:58.997251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 296/571] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:58 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:59.156111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:59.157433 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:59.165180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:59.165850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:59.166639 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:59.167278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:59.329462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:59.339743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ca9c171-3404-4b4f-a694-909f9438a165 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.187255 Nov 23 10:20:59.340365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 276/572] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:20:59 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:20:59.376147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:20:59.376863 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:20:59.387106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:59.387737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:59.388904 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:20:59.389336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:20:59.557409 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:59.569243 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:59.571047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:20:59.572989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc3fdd98-ae8f-44d7-9635-cecc91bbc648 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.201018 Nov 23 10:20:59.573766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 297/573] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:20:59 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:00.013266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:00.013928 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:00.021106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.021890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.022967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.023407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.170300 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:00.180501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fdce53e8-b82a-4d21-b6d1-d29f01b9b1a5 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1514 microversion: 2.1 time: 0.170794 Nov 23 10:21:00.181592 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 277/574] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:00 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:00.356292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:00.357107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:00.364426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.365216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.366125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.366643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.504841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:00.512998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-adc56925-602f-46ec-b60f-d283ea74cbfe tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.160345 Nov 23 10:21:00.513769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 298/575] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:00 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:00.592515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:00.593506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:00.601072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.601665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.602650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:00.603398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:00.746721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:00.757830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:00.759501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:00.760648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac3fce33-a296-4ffe-9877-cbb31bd6c902 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1738 microversion: 2.20 time: 0.172046 Nov 23 10:21:00.761197 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 278/576] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:00 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:01.198171 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:01.198771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:01.204616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.205055 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:01.205861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.206297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:01.531294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:01.533049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:01.546072 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.548145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:01.549137 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.549847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:01.632510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:01.642213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4dfc8e49-3065-498c-9db7-36026275e9d0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 200 len: 1514 microversion: 2.1 time: 0.447118 Nov 23 10:21:01.643306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 299/577] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:01 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:01.780050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:01.780944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:01.787046 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.787756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:01.789251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:01.790045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.044912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:02.056647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18766119-19c5-4cd4-ae23-c153dc700842 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.528962 Nov 23 10:21:02.061870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 279/578] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:01 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:02.067132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-20e09c78-ee77-4f02-ba65-e53a66ae957e req-4bade487-851d-46a8-bedc-b91020371865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce5c27d-d565-4560-87b5-6d47b60bd458", "name": "network-vif-deleted", "tag": "cc262c12-8cbc-492d-a17a-93e387895c04"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:02.071310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:02.071310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:02.076727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:02.079416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-20e09c78-ee77-4f02-ba65-e53a66ae957e req-4bade487-851d-46a8-bedc-b91020371865 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.080507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-20e09c78-ee77-4f02-ba65-e53a66ae957e req-4bade487-851d-46a8-bedc-b91020371865 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.087051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:02.088946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:02.090529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0343b69a-6765-480b-91fe-d37a73681a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1720 microversion: 2.20 time: 0.314910 Nov 23 10:21:02.091370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-20e09c78-ee77-4f02-ba65-e53a66ae957e req-4bade487-851d-46a8-bedc-b91020371865 service nova] Creating event network-vif-deleted:cc262c12-8cbc-492d-a17a-93e387895c04 for instance 5ce5c27d-d565-4560-87b5-6d47b60bd458 on hv-cinder-80403 Nov 23 10:21:02.091565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 300/579] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:01 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:02.096409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-20e09c78-ee77-4f02-ba65-e53a66ae957e req-4bade487-851d-46a8-bedc-b91020371865 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036344 Nov 23 10:21:02.097883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 280/580] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:02.660530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:02.661139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 5ce5c27d-d565-4560-87b5-6d47b60bd458] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:02.671322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.671322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.671984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.672500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.687773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Instance 5ce5c27d-d565-4560-87b5-6d47b60bd458 could not be found. Nov 23 10:21:02.688497 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 404 to user: Instance 5ce5c27d-d565-4560-87b5-6d47b60bd458 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:02.689336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8942c9d1-e6b6-4aa0-8712-404d576d244b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458" status: 404 len: 111 microversion: 2.1 time: 0.032649 Nov 23 10:21:02.689924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 301/581] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:02 2021] GET /compute/v2.1/servers/5ce5c27d-d565-4560-87b5-6d47b60bd458 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:21:02.701068 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:02.701647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:02.707786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.708240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.709006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.709436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.733967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:21:02.811413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ba5b2f85-5672-48a1-a459-9b5abb1c17a3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 204 len: 0 microversion: 2.1 time: 0.115807 Nov 23 10:21:02.811868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 281/582] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:21:02 2021] DELETE /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:21:02.819862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:02.820467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:02.826313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.826760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.827533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:02.827971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:02.962121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:02.969546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34048c51-10bd-4687-94e1-7d8463dc2bf2 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1514 microversion: 2.1 time: 0.153563 Nov 23 10:21:02.970142 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 302/583] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:02 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:03.076088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:03.076703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:03.082573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.083021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:03.083828 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.084240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:03.109815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:03.110579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:03.117716 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.118510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:03.119448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.120035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:03.227327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:03.240043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12851cf4-28f1-4dfb-9bcd-85c68aff007b tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.167850 Nov 23 10:21:03.240644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 282/584] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:03 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:03.256555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:03.264048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:03.265527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:03.266675 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e7c234e-cfa1-431f-895b-150181dc4ce5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1720 microversion: 2.20 time: 0.160941 Nov 23 10:21:03.267223 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 303/585] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:03 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:03.987477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:03.988634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:03.994883 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.995812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:03.996581 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:03.997009 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.130544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:04.139211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54e069c6-ae8b-4c2b-87f6-9b72ecc285b8 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1514 microversion: 2.1 time: 0.155144 Nov 23 10:21:04.139991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 283/586] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:03 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:04.257979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:04.258564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:04.264850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:04.265298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.266098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:04.266537 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.286258 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:04.287117 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:04.293137 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:04.293577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.294862 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:04.294862 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.408197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:04.417038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-974308cc-149e-435c-a796-84ffd76c5efa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.163332 Nov 23 10:21:04.417603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 304/587] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:04 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:04.439816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:04.448066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:04.449559 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:04.450755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8f7fa8e-6809-456e-a3ac-265ea6061dbe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1720 microversion: 2.20 time: 0.169180 Nov 23 10:21:04.451310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 284/588] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:04 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:04.779539 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-f641ba45-855f-4643-9bc1-9a901cdb8e33 req-03f3b843-e4f0-4211-8a22-958bbc03751f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:04.782319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:04.782319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:21:04.790069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-f641ba45-855f-4643-9bc1-9a901cdb8e33 req-03f3b843-e4f0-4211-8a22-958bbc03751f service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:04.790522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-f641ba45-855f-4643-9bc1-9a901cdb8e33 req-03f3b843-e4f0-4211-8a22-958bbc03751f service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:04.802190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-f641ba45-855f-4643-9bc1-9a901cdb8e33 req-03f3b843-e4f0-4211-8a22-958bbc03751f service nova] Creating event network-vif-unplugged:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:21:04.807253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-f641ba45-855f-4643-9bc1-9a901cdb8e33 req-03f3b843-e4f0-4211-8a22-958bbc03751f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031304 Nov 23 10:21:04.807812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 305/589] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:05.162535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:05.163480 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:05.169768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.170177 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.170945 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.171377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.305774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:05.313146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87b7ab04-ad67-41e2-b15a-5ba0bf0c4f8c tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1514 microversion: 2.1 time: 0.154889 Nov 23 10:21:05.313735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 285/590] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:05 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:05.435947 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:05.436771 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:05.443087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.443528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.444297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.444723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.470033 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:05.470884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:05.478193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.478634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.479413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:05.479840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:05.588817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:05.596544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-358ddf40-69e3-4414-9632-6dc0fb79c8bf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.166281 Nov 23 10:21:05.597240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 306/591] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:05 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:05.622121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:05.630238 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:05.631717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:05.632917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-008d5676-0415-4299-977e-367aa1ffd02e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1720 microversion: 2.20 time: 0.166559 Nov 23 10:21:05.633477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 286/592] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:05 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:06.332286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:06.333243 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:06.340095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.340614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.341668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.342248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.479942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:06.487278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98578874-0a0a-4377-bdf2-6e85f434d5ec tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1514 microversion: 2.1 time: 0.158875 Nov 23 10:21:06.488386 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 307/593] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:06 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:06.510427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-138372216", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "networks": [{"uuid": "60bfbda0-c680-4ce8-8529-cba547c6f159"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:06.561639 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] validate_networks() for [('60bfbda0-c680-4ce8-8529-cba547c6f159', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:21:06.613650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:06.614453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:06.620262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.620720 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.621499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.621962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.760329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:06.767974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3082a2cf-32e5-4800-9760-f2830a8a783d tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.158571 Nov 23 10:21:06.768556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 308/594] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:06 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:06.772756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:06.773356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:06.779088 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.779546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.780326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.780763 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.924523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:21:06.925020 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:21:06.926570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:21:06.927563 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:21:06.928286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:21:06.933968 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:06.938706 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.939257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.940247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:06.940743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:06.942644 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:06.944184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:06.945331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0bec42a8-a855-4aff-be15-08bd58a5ba2a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1720 microversion: 2.20 time: 0.175859 Nov 23 10:21:06.946070 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 309/595] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:06 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:06.959209 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Getting quotas for project 436a5a3020ea46dfb81f427e8c9f0163. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:21:06.963207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Getting quotas for user 65d9c8d8f04c4ff6a12bc1b1645f09aa and project 436a5a3020ea46dfb81f427e8c9f0163. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:21:06.975502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:21:06.977840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:21:07.020767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-243e53db-c766-4fc0-af00-4681c72c5065 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514043 Nov 23 10:21:07.021409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 287/596] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:21:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:21:07.031069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-183ddc47-2bab-4b9c-9503-8d0690494b3f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:07.031768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-183ddc47-2bab-4b9c-9503-8d0690494b3f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:07.086952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-183ddc47-2bab-4b9c-9503-8d0690494b3f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:07.093431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-183ddc47-2bab-4b9c-9503-8d0690494b3f tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1218 microversion: 2.1 time: 0.066053 Nov 23 10:21:07.094043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 310/597] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:07 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:07.504881 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:07.505510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:07.511679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.512261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.512888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.513328 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.656777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:07.664501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb0056fc-0eef-41f5-ae59-fdf5a072bc8b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1514 microversion: 2.1 time: 0.164042 Nov 23 10:21:07.665398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 288/598] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:07 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:07.784613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:07.785392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:07.792061 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.792581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.793471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.794011 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.965208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:07.965950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:07.970598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:07.973040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.973629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.974884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:07.975497 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:07.980003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb35720f-12ac-4dbc-aefe-9b09f34a34b4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.199357 Nov 23 10:21:07.980793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 311/599] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:07 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:08.110616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:08.111361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:08.118078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.119178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.119455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.119561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:08.120003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.129658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:08.131203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:08.132543 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9da51008-0726-4bf0-b188-8d8c3641b0e4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1723 microversion: 2.20 time: 0.172721 Nov 23 10:21:08.133215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 289/600] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:07 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:08.152732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d9cd580-d793-4880-a60a-39beb6f1173f"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:08.157321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:08.172470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.174133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.174133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.174326 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.212419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:08.223868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e94b4fc1-53d1-4e7e-9f9c-f3690c602365 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1270 microversion: 2.1 time: 0.116693 Nov 23 10:21:08.224459 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 312/601] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:08 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:08.484052 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-22cde912-f213-43c7-9379-ac1de5284eb1 req-acf680b6-676e-43da-83df-43366d46753c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce254180-2115-487d-8d54-23117d159234", "name": "network-vif-deleted", "tag": "b1774df1-a8ba-4f81-9422-fd03be19793e"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:08.486006 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:08.486006 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:21:08.509935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-22cde912-f213-43c7-9379-ac1de5284eb1 req-acf680b6-676e-43da-83df-43366d46753c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.515545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-22cde912-f213-43c7-9379-ac1de5284eb1 req-acf680b6-676e-43da-83df-43366d46753c service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.543622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-22cde912-f213-43c7-9379-ac1de5284eb1 req-acf680b6-676e-43da-83df-43366d46753c service nova] Creating event network-vif-deleted:b1774df1-a8ba-4f81-9422-fd03be19793e for instance ce254180-2115-487d-8d54-23117d159234 on hv-cinder-80403 Nov 23 10:21:08.565851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-22cde912-f213-43c7-9379-ac1de5284eb1 req-acf680b6-676e-43da-83df-43366d46753c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084861 Nov 23 10:21:08.566999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 313/602] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:08.618462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-10211ad6-4bc8-46b2-9daa-f7ce67e51da9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.469478 Nov 23 10:21:08.619719 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 290/603] 10.222.0.41 () {62 vars in 1363 bytes} [Tue Nov 23 10:21:08 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments => generated 188 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:21:08.682158 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:08.686925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:08.694938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.695312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.696115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.696528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.735883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.735883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.735883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lazy-loading 'fault' on Instance uuid ce254180-2115-487d-8d54-23117d159234 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:21:08.745552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:08.746158 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:08.755031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.755482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.756971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.756971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.779982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:08.788455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40dd8cd4-a69a-4db6-bc15-86236a260312 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 200 len: 1308 microversion: 2.1 time: 0.110104 Nov 23 10:21:08.798498 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 314/604] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:08 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:08.858455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6e26c67-8cdc-47b7-96ce-fa7c857ab498 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action" status: 202 len: 0 microversion: 2.20 time: 0.116443 Nov 23 10:21:08.859257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 291/605] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:21:08 2021] POST /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:21:08.871359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:08.872415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:08.881435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.882269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.883249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:08.883678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:08.997054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:08.997669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:09.008968 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.013045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.013943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.014385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.076582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:09.093978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:09.096502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:09.097776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dba01a0d-a4e6-46f6-8c6e-7e7fa524fdaf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1749 microversion: 2.20 time: 0.232368 Nov 23 10:21:09.098705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 315/606] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:08 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1749 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:09.243018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:09.244768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:09.251933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.252681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.254210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.254788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.347016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:09.366558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8027944d-787d-470e-9bc1-788278152106 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.372200 Nov 23 10:21:09.370082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 292/607] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:08 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:09.414221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:09.426040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50cb31b9-0863-43e4-a817-712b7cfd96e0 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.187916 Nov 23 10:21:09.427347 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 316/608] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:09 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:09.806793 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:09.808087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: ce254180-2115-487d-8d54-23117d159234] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:09.813979 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.814421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.815298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.815756 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:09.829518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Instance ce254180-2115-487d-8d54-23117d159234 could not be found. Nov 23 10:21:09.830076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 404 to user: Instance ce254180-2115-487d-8d54-23117d159234 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:09.831333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-192bb0c3-3ce7-4f17-b8a6-20e8db1157bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234" status: 404 len: 111 microversion: 2.1 time: 0.027954 Nov 23 10:21:09.831596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 293/609] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:09 2021] GET /compute/v2.1/servers/ce254180-2115-487d-8d54-23117d159234 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:21:09.980048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-248cc9ea-98a1-47a6-861e-d354bb4d1440 req-06be2517-d9ba-41ff-a877-7f57203d0030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30a1ebf-90a9-41e9-b3c4-4acade4f386f", "tag": "3719ef05-a5c5-4edb-a934-e7201effed22"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:09.984074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:09.984074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:21:09.994032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-248cc9ea-98a1-47a6-861e-d354bb4d1440 req-06be2517-d9ba-41ff-a877-7f57203d0030 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:09.994588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-248cc9ea-98a1-47a6-861e-d354bb4d1440 req-06be2517-d9ba-41ff-a877-7f57203d0030 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.007986 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-248cc9ea-98a1-47a6-861e-d354bb4d1440 req-06be2517-d9ba-41ff-a877-7f57203d0030 service nova] Creating event network-changed:3719ef05-a5c5-4edb-a934-e7201effed22 for instance c30a1ebf-90a9-41e9-b3c4-4acade4f386f on hv-cinder-80403 Nov 23 10:21:10.013403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-248cc9ea-98a1-47a6-861e-d354bb4d1440 req-06be2517-d9ba-41ff-a877-7f57203d0030 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037105 Nov 23 10:21:10.016858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 317/610] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:10.115091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:10.115757 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:10.122016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.122541 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.123466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.123904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.359673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:10.368399 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:10.370603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:10.371775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-309149ce-62f3-43d1-b68d-9a489d60ebcd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1751 microversion: 2.20 time: 0.260463 Nov 23 10:21:10.372395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 294/611] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:10 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:10.387691 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:10.388501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:10.395515 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.395966 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.396755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.397189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.443529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:10.444141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:10.450216 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.450667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.451454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.451890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.559439 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:10.568895 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4d51359-549f-4ecb-a37d-d8680521c819 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.188897 Nov 23 10:21:10.569916 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 318/612] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:10 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:10.643727 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:10.652465 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0754945d-27f8-4808-afa1-6231a544019b tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.213265 Nov 23 10:21:10.653058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 295/613] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:10 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:10.983217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:10.983799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:10.991190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.991649 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:10.992641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:10.993077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.019410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:21:11.097877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b477c804-1c1a-4478-9166-332e1a0a00f3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 204 len: 0 microversion: 2.1 time: 0.117319 Nov 23 10:21:11.099183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 319/614] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:21:10 2021] DELETE /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:21:11.107373 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:11.108166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:11.117285 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.118411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.119601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.119601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.323643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.331011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68b6d7a4-f60f-4089-a3ee-0664daeb6a44 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.227890 Nov 23 10:21:11.331581 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 296/615] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:11 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:11.391656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:11.392267 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:11.398748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.399193 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.399975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.400406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.529599 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.541274 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.543221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.544532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f895fb43-ecf0-484c-8549-6d316aed1ef1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.156987 Nov 23 10:21:11.545094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 320/616] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:11 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:11.586436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:11.587045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:11.592651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.593093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.593882 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.594320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.669378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:11.669949 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:11.675718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.676195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.677060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:11.677489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:11.807702 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.812714 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:11.815414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ed2a877-fbc6-4dfb-9417-3c1c1955c521 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.149758 Nov 23 10:21:11.816523 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 321/617] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:11 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:11.821493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7801d4ca-1050-40f0-b789-652319520f75 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.238591 Nov 23 10:21:11.822235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 297/618] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:11 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:12.348626 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:12.353551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:12.373921 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.374795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.375850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.380434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.563088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:12.565343 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:12.572561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.573430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.574461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.575156 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.660516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:12.668684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56d90c81-0b73-4fe3-bb39-4adbc075b1d7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.324481 Nov 23 10:21:12.674644 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 322/619] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:12 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:12.762545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:12.771188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:12.772703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:12.773876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-73e47e21-64b2-4f5e-97ef-af9ce4e26beb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.214875 Nov 23 10:21:12.774433 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 298/620] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:12 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:12.832052 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:12.832682 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:12.837892 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:12.838507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:12.839797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.840326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.841186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.841711 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.844501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.844950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.845763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:12.846419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:12.991147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:12.998160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:13.002678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d369050-c3fe-46b6-a465-900ed31a7b0c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.168226 Nov 23 10:21:13.003507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 299/621] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:12 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:13.009674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d57ba59-70f2-4cb1-88ba-028548101d65 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.181164 Nov 23 10:21:13.010790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 323/622] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:12 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:13.685435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:13.686056 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:13.693096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:13.693548 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:13.694380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:13.694818 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:13.792891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:13.793647 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:13.800553 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:13.800878 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:13.801674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:13.802323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:13.829833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:13.837871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7210f869-1ac7-4d80-b74d-c42ed6a27eea tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.155957 Nov 23 10:21:13.838456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 300/623] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:13 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:13.948187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:13.957441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:13.959153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:13.960306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9aa3d8b5-b0d9-4821-9ef9-39cc488addb8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.172059 Nov 23 10:21:13.960872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 324/624] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:13 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:14.020529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:14.021136 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:14.027564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:14.028248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.028438 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:14.028687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.029637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.030097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.034243 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.035225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.036293 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.036601 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.182795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:14.183150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:14.190909 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8aba5eef-7bc0-47b1-a4f1-e2a9f75b1218 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.167336 Nov 23 10:21:14.191115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ae35373a-7a64-400f-871e-ebf3973316b8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.174256 Nov 23 10:21:14.191746 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 325/626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:14 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:14.192004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 301/626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:14 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:14.495028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b1df2f8b-de35-40fc-bc07-bca4d49c4adb req-3ea7e36a-8923-44b9-90f9-13493b724cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30a1ebf-90a9-41e9-b3c4-4acade4f386f", "name": "network-vif-plugged", "status": "completed", "tag": "3719ef05-a5c5-4edb-a934-e7201effed22"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:14.498041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:14.498041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:14.506391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b1df2f8b-de35-40fc-bc07-bca4d49c4adb req-3ea7e36a-8923-44b9-90f9-13493b724cea service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.507064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b1df2f8b-de35-40fc-bc07-bca4d49c4adb req-3ea7e36a-8923-44b9-90f9-13493b724cea service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.520206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b1df2f8b-de35-40fc-bc07-bca4d49c4adb req-3ea7e36a-8923-44b9-90f9-13493b724cea service nova] Creating event network-vif-plugged:3719ef05-a5c5-4edb-a934-e7201effed22 for instance c30a1ebf-90a9-41e9-b3c4-4acade4f386f on hv-cinder-80403 Nov 23 10:21:14.526371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b1df2f8b-de35-40fc-bc07-bca4d49c4adb req-3ea7e36a-8923-44b9-90f9-13493b724cea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Nov 23 10:21:14.527503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 302/627] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:14.854794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:14.855313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:14.861798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.862147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.862937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.863372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.981276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:14.982604 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:14.988847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.989298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.990113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:14.990728 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:14.998769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.006786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-976ad7b9-ce12-4d45-b3b2-e8208e4e7e46 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.155888 Nov 23 10:21:15.011448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 326/628] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:14 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:15.128544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.137437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.139151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.140309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-29539976-430f-440a-848e-03a7235c4c4f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.163570 Nov 23 10:21:15.140872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 303/629] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:14 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:15.207843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:15.208062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:15.208451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:15.208591 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:15.214875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:15.215017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:15.215318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:15.215441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:15.216097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:15.216195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:15.216526 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:15.216622 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:15.383087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.387048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:15.390573 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e9e4f515-42b4-419e-ae64-729f509ff684 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.186338 Nov 23 10:21:15.391343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 327/630] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:15 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:15.396025 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-217fc71e-a3f5-4f43-9d5f-fc1282ec4073 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.191698 Nov 23 10:21:15.396789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 304/631] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:15 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:16.024331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:16.024989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:16.031195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.031639 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.032411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.032840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.159129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:16.160667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:16.167184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.167658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.168455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.168889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.174111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.181472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10466250-8c64-495b-8841-e3780e7232a0 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.160754 Nov 23 10:21:16.182094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 328/632] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:16 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:16.312668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.321642 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.323165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.324323 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-31ab2f73-6215-453c-8687-0bda0e6b5094 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.169126 Nov 23 10:21:16.324898 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 305/633] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:16 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:16.408175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:16.409037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:16.417869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:16.418509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:16.427309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.429217 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.429673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.430495 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.430934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.433955 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.434814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:16.435260 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:16.592067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.594079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:16.601015 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fb5233c-77e0-4ff0-9712-e91f9b7c0a41 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.196605 Nov 23 10:21:16.602111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dfbb5d64-1b4e-4fd9-8b77-b629ca0ff38c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.188077 Nov 23 10:21:16.602964 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 306/634] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:16 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:16.616135 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 329/635] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:16 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:17.198919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:17.199522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:17.206700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.207389 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.208357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.208789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.347589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:17.348950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:17.355334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.355919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.356566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.356998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.357307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.375564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ab193a8-4d3e-428d-a61a-9b2e2ddc5136 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.173301 Nov 23 10:21:17.378987 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 307/636] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:17 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:17.490660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2091153861", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1268409533", "security_groups": [{"name": "tempest-secgroup-smoke-1740755750"}], "networks": [{"uuid": "3abb029a-7ebf-4439-b8dc-4cb9864125d4"}], "block_device_mapping_v2": [{"uuid": "6d7ade24-449c-4350-a7df-2d92a2cc28f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:17.507589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.515739 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.517211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.518413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c8fc3dc-8f19-4604-8519-4eaa977ef758 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.175928 Nov 23 10:21:17.520912 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 330/637] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:17 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:17.618892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:17.619496 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:17.626277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.626277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.627824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.629594 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.634927 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] validate_networks() for [('3abb029a-7ebf-4439-b8dc-4cb9864125d4', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:21:17.789161 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.796952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47227b1b-8c20-4d81-97ec-b00b66088eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.181561 Nov 23 10:21:17.807466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 331/638] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:17 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:17.812373 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:17.812978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:17.820379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.820823 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.821617 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:17.822081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:17.969588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:17.979081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f1acd5d-1e14-4e58-a2e0-d63d762e5509 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.170352 Nov 23 10:21:17.979895 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 332/639] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:17 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:18.239412 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:21:18.239924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:21:18.240287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:21:18.240690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:21:18.241096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:21:18.250148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.250741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.251556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.251992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.269080 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:21:18.273104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Getting quotas for user a72ae5b8eb4d47f48e174c90e5398860 and project ec14da7ea5f14a4fa94558a450bc7b98. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:21:18.333179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:21:18.335386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d7ade24-449c-4350-a7df-2d92a2cc28f9',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:21:18.392468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:18.394030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:18.400777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.401513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.402619 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.403271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.483711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-40fccd5b-7d46-4b38-af06-3aafa9d7585f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.997855 Nov 23 10:21:18.484656 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 308/640] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:21:17 2021] POST /compute/v2.1/servers => generated 406 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:21:18.495297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-681c73a3-90c4-498b-a6b0-8a215728b407 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:18.496044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-681c73a3-90c4-498b-a6b0-8a215728b407 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:18.582640 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-681c73a3-90c4-498b-a6b0-8a215728b407 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:18.593096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-681c73a3-90c4-498b-a6b0-8a215728b407 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1089 microversion: 2.1 time: 0.101553 Nov 23 10:21:18.603237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 309/641] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:18 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1089 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:18.606138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:18.606666 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:18.615786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.616366 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.617178 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.617724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.619093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:18.630855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46961a8a-7b76-4793-84b8-d6e44cbb90b9 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.242157 Nov 23 10:21:18.631430 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 333/642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:18 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:18.785715 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:18.797263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:18.799567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:18.803481 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05f1f323-9e9c-4c58-85e0-7250972e2818 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.207982 Nov 23 10:21:18.804144 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 310/643] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:18 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:18.814219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:18.814937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:18.822107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.822655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:18.834621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:18.835413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.002271 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.006575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:19.007223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:19.013105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.013561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.014397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.014836 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.015623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e0e6ce94-54a3-47ad-adc2-de44afb27a6c tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.205007 Nov 23 10:21:19.016210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 334/644] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:18 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:19.161335 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.169732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7774e6e1-a083-4ee7-be43-15e2e37c8abd tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.175800 Nov 23 10:21:19.170326 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 311/645] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:18 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:19.612894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:19.613532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:19.620021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.620563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.621416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.621946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.649784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:19.650556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:19.656718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.657299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.658214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.658752 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.684873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.693722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1192b6e-0a6b-4afd-b6fe-ca0088217b69 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1139 microversion: 2.1 time: 0.084923 Nov 23 10:21:19.694505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 335/646] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:19 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:19.823408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.828138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:19.828747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:19.832081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e6626b0-f67e-4bd3-8b84-481cf561ffe7 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.186737 Nov 23 10:21:19.833596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 312/647] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:19 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:19.835331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.836006 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.836790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:19.837216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:19.973005 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.981668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.983198 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:19.984401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0181f8bd-939d-4a79-82b0-cbf1749e0f2c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.165449 Nov 23 10:21:19.984929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 336/648] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:19 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:20.037443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:20.038357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:20.045093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.045544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.046992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.047203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.187900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:20.188889 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:20.194247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:20.197090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.198146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.199372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.199989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.208947 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8cf08ebe-abf1-4ba5-b6f0-e43341949462 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.174984 Nov 23 10:21:20.218735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 313/649] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:20 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:20.343110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:20.351895 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da407115-df04-4299-b1d5-e84c07052eac tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.167930 Nov 23 10:21:20.352867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 337/650] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:20 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:20.712721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:20.713324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:20.720000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.720450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.721250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.722330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.781513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:20.790054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0e0582a-55bf-41de-a905-35fa1bdc9fce tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1139 microversion: 2.1 time: 0.080972 Nov 23 10:21:20.790641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 314/651] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:20 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:20.851812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:20.853042 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:20.859379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.859829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.860614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:20.861048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:20.996652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.003354 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:21.004250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:21.005097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d51dd2ce-587d-46e6-aa5a-88c55df6ec8d tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.157098 Nov 23 10:21:21.005830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 338/652] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:20 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:21.011562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.012011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.012860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.013274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.152841 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.161564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.163359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.164528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75092ac9-cce6-4e53-9cd8-ffbb58fb5c40 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.165430 Nov 23 10:21:21.165285 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 315/653] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:20 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:21.224194 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:21.224806 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:21.230752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.231205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.231991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.232425 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.370461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.371794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:21.372671 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:21.379998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.380458 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.381514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.381975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.383043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c985ad1-ccce-4a9c-a8b5-9c7060e0810d tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.162543 Nov 23 10:21:21.385730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 339/654] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:21 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:21.529916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.548112 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7481dc64-16b6-464d-be73-31de2abb34e7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.179736 Nov 23 10:21:21.548634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 316/655] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:21 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:21.807572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:21.808089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:21.814361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.814930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.815729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:21.816159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:21.877154 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:21.885396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4fe3a31-f826-4569-83a0-aa8c447eaf11 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1139 microversion: 2.1 time: 0.081440 Nov 23 10:21:21.886453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 340/656] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:21 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:22.023278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:22.023895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:22.030344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.030799 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.031582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.032023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.170160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.179998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a5df12d-0115-469c-ae1d-76de3a5782d3 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.161102 Nov 23 10:21:22.183935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:22.185160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:22.190182 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 317/657] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:22 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:22.193253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.193855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.194768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.195211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.335074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.343523 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.344997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.346205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-472bbe5a-7713-478b-b08b-91b048bff6a3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.167309 Nov 23 10:21:22.346769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 341/658] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:22 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:22.400428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:22.401065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:22.407271 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.407722 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.408569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.408956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.558170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.565957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-345dcbae-f5ae-410c-9a9d-df12c0e29484 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.169021 Nov 23 10:21:22.566984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:22.567113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 318/659] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:22 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:22.567669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:22.574825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.575282 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.576073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.576512 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.723836 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.731952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e238185a-5a51-46dd-a385-bfb861fdcab0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.169646 Nov 23 10:21:22.732547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 342/660] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:22 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:22.902252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:22.902895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:22.908901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.909350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.910188 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:22.911313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:22.974915 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:22.983048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dace2c5e-badb-455c-8803-a6da6170fbb4 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1139 microversion: 2.1 time: 0.084349 Nov 23 10:21:22.983733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 319/661] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:22 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:23.196603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:23.197273 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:23.203609 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.204060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.204841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.205280 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.335212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.342340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c2e3aa6b-86e1-4e33-a398-1bc75cafa51b tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.149495 Nov 23 10:21:23.342906 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 343/662] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:23 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:23.364567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:23.365168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:23.371785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.372235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.373014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.373453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.501536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.509876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.511466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.512734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07da4a5e-2ff6-4218-b4b6-0705cb56b663 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.152359 Nov 23 10:21:23.513310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 320/663] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:23 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:23.586307 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:23.586908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:23.592973 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.593419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.594248 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.594679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.736114 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.748154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:23.757170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:23.760249 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96b678b7-02f0-48c9-94f5-f844080234e8 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.162814 Nov 23 10:21:23.764424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.765172 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.765646 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:23.765810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 344/664] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:23 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:23.766177 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:23.961129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:23.968902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-78333cee-cbf5-4ec9-ad55-428e7c8a71cf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.224359 Nov 23 10:21:23.969476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 321/665] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:23 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:24.001473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:24.002054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:24.008418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.008865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.009631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.010094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.070602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.077844 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-286a3208-da83-4b1b-82de-48b8ef3d9d04 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1187 microversion: 2.1 time: 0.080023 Nov 23 10:21:24.078406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 345/666] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:23 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1187 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:24.359323 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:24.359930 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:24.366408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.366974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.367601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.368033 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.508315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.516733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c12ab82d-a187-4091-b30f-33bc1e0d67bd tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1513 microversion: 2.1 time: 0.160958 Nov 23 10:21:24.517372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 322/667] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:24 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:24.531887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:24.532783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:24.540719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.541144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.541953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.542618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.687197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.696441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.698016 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.699314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a4ad158-8732-4e31-a147-4e68d778c982 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.171573 Nov 23 10:21:24.701741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 346/668] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:24 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:24.777171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:24.778035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:24.784702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.785379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.786265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:24.786699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:24.974629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:24.983304 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-51848b95-b3e4-42ae-9066-05e81f441f20 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1318 microversion: 2.1 time: 0.210051 Nov 23 10:21:24.984085 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 323/669] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:24 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:24.994789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:24.995403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:25.001684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.002307 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.003162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.003709 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.095386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:25.096461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:25.103377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.103911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.104711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.105145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.196272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.204827 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8153f979-7254-451a-bbcc-56110c36222d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1205 microversion: 2.1 time: 0.113278 Nov 23 10:21:25.227878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 324/670] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:25 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1205 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:25.236734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.247903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cf89de24-9fd2-445d-a12b-f2d5feac16f1 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.265786 Nov 23 10:21:25.258176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 347/671] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:24 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:25.539029 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:25.540022 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:25.556101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.560606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.561872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.562494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.700342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a87253271364cf6a2052015801aa0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b011b5c1240f2838d04766f5a1fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.709969 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a726dba1-83c8-489e-9a82-723f5f38c557 tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 200 len: 1471 microversion: 2.1 time: 0.179939 Nov 23 10:21:25.710814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 325/672] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:25 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:25.718224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:25.719708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:25.729371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-eb4d1eab-31c3-4fc2-a6a0-e397d3933003 req-675bd658-97b4-4782-b326-57490e8cb841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a2f89c-cd1e-472b-bc51-568cf7ef32ba", "name": "network-vif-deleted", "tag": "b572437e-c6ba-4ba4-a235-174248ee5da0"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:25.730004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.730659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.731082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:25.731082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:25.732395 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.732846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.738877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-eb4d1eab-31c3-4fc2-a6a0-e397d3933003 req-675bd658-97b4-4782-b326-57490e8cb841 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:25.739561 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-eb4d1eab-31c3-4fc2-a6a0-e397d3933003 req-675bd658-97b4-4782-b326-57490e8cb841 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:25.767235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-eb4d1eab-31c3-4fc2-a6a0-e397d3933003 req-675bd658-97b4-4782-b326-57490e8cb841 service nova] Creating event network-vif-deleted:b572437e-c6ba-4ba4-a235-174248ee5da0 for instance 06a2f89c-cd1e-472b-bc51-568cf7ef32ba on hv-cinder-80403 Nov 23 10:21:25.772457 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-eb4d1eab-31c3-4fc2-a6a0-e397d3933003 req-675bd658-97b4-4782-b326-57490e8cb841 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049554 Nov 23 10:21:25.773214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 326/673] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:25.899820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.908196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.909777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:25.911548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67abe16f-56f3-4d0c-9f8d-317b451a7a71 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.197235 Nov 23 10:21:25.912117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 348/674] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:25 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:26.000726 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:26.001463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.011196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.011646 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.012436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.012873 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.232325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:26.233074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.239857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.239995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:26.240311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.241116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.241643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.247742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac2d0e5a-277f-4a2d-ad04-b7da5621b515 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1507 microversion: 2.1 time: 0.250994 Nov 23 10:21:26.248518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 327/675] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:25 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:26.264665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "597acb01-abb0-4993-b6f1-40d91de0d058", "device": "/dev/sdb"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:26.265787 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.271705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.272353 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.273129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.273566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.403926 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:26.416213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ee87ffa-c27a-40ca-972e-f3c2cbee66c8 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.187265 Nov 23 10:21:26.427365 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 349/676] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:26 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:26.433767 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:26.434449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.443469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.444252 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.446124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.446946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.633893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:26.645110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-480f0358-434b-49be-be9a-a2f67a4223ed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1566 microversion: 2.1 time: 0.215554 Nov 23 10:21:26.646309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 350/677] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:26 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:26.650870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-f74e450b-1cc0-4d43-b682-3aaa57e2916e req-75671946-6a8c-4965-92ad-0f0bfa3bf7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:26.652403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:26.652403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:21:26.660151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-f74e450b-1cc0-4d43-b682-3aaa57e2916e req-75671946-6a8c-4965-92ad-0f0bfa3bf7de service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.660823 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-f74e450b-1cc0-4d43-b682-3aaa57e2916e req-75671946-6a8c-4965-92ad-0f0bfa3bf7de service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.676324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-f74e450b-1cc0-4d43-b682-3aaa57e2916e req-75671946-6a8c-4965-92ad-0f0bfa3bf7de service nova] Creating event network-changed:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:21:26.682077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-f74e450b-1cc0-4d43-b682-3aaa57e2916e req-75671946-6a8c-4965-92ad-0f0bfa3bf7de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034513 Nov 23 10:21:26.683440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 351/678] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:26.729369 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:26.730153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] [instance: 06a2f89c-cd1e-472b-bc51-568cf7ef32ba] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.733738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2e473b67-d969-4263-b609-f4525fc950d9 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "POST /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472301 Nov 23 10:21:26.734357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 328/679] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:21:26 2021] POST /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:26.741628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.742865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.744007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.744623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.760301 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] HTTP exception thrown: Instance 06a2f89c-cd1e-472b-bc51-568cf7ef32ba could not be found. Nov 23 10:21:26.760946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] Returning 404 to user: Instance 06a2f89c-cd1e-472b-bc51-568cf7ef32ba could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:26.761905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f00986c2-78b6-4bb0-9678-279a4e0c624e tempest-AttachVolumeNegativeTest-1094407685 tempest-AttachVolumeNegativeTest-1094407685-project] 10.222.0.41 "GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba" status: 404 len: 111 microversion: 2.1 time: 0.036984 Nov 23 10:21:26.762830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 352/680] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:26 2021] GET /compute/v2.1/servers/06a2f89c-cd1e-472b-bc51-568cf7ef32ba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:21:26.933350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:26.935257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:26.944174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.944777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:26.946087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:26.947168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.120853 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:27.131471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:27.133064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:27.134264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e390319-3708-4fc4-9110-5e34f3c381f7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.207276 Nov 23 10:21:27.134999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 329/681] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:26 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:27.436605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:27.437185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:27.447821 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.448292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.451518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.452967 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.599912 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:27.607703 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06e74f3a-bc38-450f-a469-61f2a6a1826e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.176590 Nov 23 10:21:27.608360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 353/682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:27 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:27.663195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:27.663812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:27.670258 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.670744 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.671717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.672233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.819089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:27.831390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-466565b5-f1c5-4272-8b7e-2d46f2f423e8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1546 microversion: 2.1 time: 0.172802 Nov 23 10:21:27.832058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 330/683] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:27 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:27.850212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:27.850899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:27.856740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.857180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.858054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.858486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.939852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] HTTP exception thrown: Cannot 'detach_volume' instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc while it is in vm_state rescued Nov 23 10:21:27.940448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Returning 409 to user: Cannot 'detach_volume' instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc while it is in vm_state rescued {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:27.941966 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-700ed21d-18ad-499a-99eb-6c2915262b3a tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments/f8983448-1228-41ba-9167-b8816a5a8973" status: 409 len: 152 microversion: 2.1 time: 0.095792 Nov 23 10:21:27.942840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 354/684] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:21:27 2021] DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments/f8983448-1228-41ba-9167-b8816a5a8973 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 10:21:27.951210 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:27.951741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:27.958029 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.958480 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:27.959245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:27.959676 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.030685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ee097f5-1409-424d-9e9c-6dd03185666c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.082830 Nov 23 10:21:28.031403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 331/685] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:21:27 2021] POST /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:21:28.042637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:28.043259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:28.052781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.053483 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.054342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.054781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.158270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:28.159290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:28.169153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.169598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.170401 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.174848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.229528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:28.239817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8afe9689-0b8c-41d6-9f8c-313f5d37031c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1554 microversion: 2.1 time: 0.202031 Nov 23 10:21:28.240312 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 355/686] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:28 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:28.395876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:28.407477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:28.409019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:28.410447 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d07adcaf-7908-478b-861e-3ecdd1eb57ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.261507 Nov 23 10:21:28.422228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 332/687] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:28 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:28.625345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:28.626171 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:28.633588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.634245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.635621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:28.635961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:28.782004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:28.789654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a6836143-967d-4399-a0ea-0969848cebaf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.168363 Nov 23 10:21:28.790443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 356/688] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:28 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:29.257759 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:29.258377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:29.264749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.265134 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.265947 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.266390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.404099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:29.413530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93a44159-d604-417b-800c-d5c4eccca9b0 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1554 microversion: 2.1 time: 0.159280 Nov 23 10:21:29.414247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 333/689] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:29 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:29.428914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:29.430164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:29.436004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.436433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.437218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.437652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.582789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:29.590794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:29.592398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:29.593528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-08dcadc6-e71a-4167-adbf-49d228b27192 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.168928 Nov 23 10:21:29.594130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 357/690] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:29 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:29.806683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:29.807202 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:29.813104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.813550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.814355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:29.814795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:29.950834 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:29.958740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-919259dd-acb9-4762-8fcf-54bdea19693d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.155774 Nov 23 10:21:29.959320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 334/691] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:29 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:30.435231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:30.435827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:30.443425 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.443869 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:30.444637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.445070 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:30.574813 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:30.582708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6029330-2beb-4815-aa09-dcdb643256a7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1554 microversion: 2.1 time: 0.151080 Nov 23 10:21:30.583284 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 358/692] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:30 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:30.614324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:30.615645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:30.624038 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.624493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:30.625273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.625716 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:30.761763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:30.770638 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:30.772473 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:30.773686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7c0446e2-4c03-4640-9825-d0de110b57c5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.163774 Nov 23 10:21:30.774339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 335/693] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:30 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:30.975801 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:30.976410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:30.982588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.983047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:30.983834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:30.984272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.116376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:31.123688 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac001e29-b4bf-46b2-9ded-1d6ea0e5124c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.152102 Nov 23 10:21:31.124255 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 359/694] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:30 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:31.599510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:31.600124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:31.606016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.606466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.607235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.607677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.734367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:31.742660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de5cec17-cb78-40a8-896f-de2a44271fa4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1560 microversion: 2.1 time: 0.146832 Nov 23 10:21:31.743232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 336/695] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:31 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:31.791687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:31.792309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:31.804441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.804884 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.805666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.806118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.809533 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:31.810079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:31.818324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.819000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.819780 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.820208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.900922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lazy-loading 'services' on Instance uuid afe7ef11-1dd1-496b-b4d6-de2f5505c8dc {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:21:31.936852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:31.946919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:31.948477 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:31.949962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7d22d4b-2814-442f-b8be-5a08d86c8a87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.162206 Nov 23 10:21:31.951014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 360/696] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:31 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:31.972673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-97c63d49-e421-48bb-aa65-87e408998abf tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments/f8983448-1228-41ba-9167-b8816a5a8973" status: 202 len: 0 microversion: 2.1 time: 0.167440 Nov 23 10:21:31.973256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 337/697] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:21:31 2021] DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments/f8983448-1228-41ba-9167-b8816a5a8973 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:21:31.981596 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:31.982712 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:31.989914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.990629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:31.991531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:31.992112 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:32.033788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-266eaca1-5174-44f8-8fa5-141253b8ca02 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054529 Nov 23 10:21:32.037820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 361/698] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:31 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:32.141372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:32.142095 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:32.149231 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:32.149791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:32.150565 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:32.150991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:32.294579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:32.302500 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55cb96cb-6f94-48fb-ac51-96243b4f4397 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.165731 Nov 23 10:21:32.303068 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 338/699] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:32 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:32.969100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:32.969719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:32.976094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:32.976545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:32.977326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:32.977799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:33.044347 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:33.045327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:33.051697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:33.052153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:33.052940 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:33.053371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:33.083788 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0f53fd28-8a9b-4a34-a384-5bca36e9c679 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 Nov 23 10:21:33.087456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 339/700] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:33 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:33.105156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:33.113565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:33.115186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:33.116334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83a60938-a39a-40ad-8905-d0a78dc8dca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.151000 Nov 23 10:21:33.116900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 362/701] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:32 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:33.319667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:33.320273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:33.326057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:33.326499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:33.327259 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:33.327687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:33.459766 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:33.466998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-891af314-fd96-4372-a7bf-2a09b1603214 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.151614 Nov 23 10:21:33.467568 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 340/702] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:33 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:34.095195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:34.096247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:34.103340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.103784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.104556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.104988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.134404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:34.134979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-37ae1361-f067-4a63-9b03-93bd82ae9edc tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Nov 23 10:21:34.135394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 363/703] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:34 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:34.138411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:34.145448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.145929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.146777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.147218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.281342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:34.292287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:34.293858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:34.295059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2f7675f-daa6-4b59-882c-6d9f85fb9751 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.164439 Nov 23 10:21:34.295617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 341/704] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:34 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:34.483002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:34.483622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:34.489770 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.490220 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.490992 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:34.491427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:34.621563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:34.629320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-376ced7d-13b8-40e4-be0f-362d777d1824 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.149998 Nov 23 10:21:34.629914 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 364/705] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:34 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:35.146004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:35.146965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:35.153460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.153965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.154745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.155183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.189309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60e910c6-42c3-4157-97e1-835abab41780 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Nov 23 10:21:35.190273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 342/706] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:35 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:35.312427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:35.313038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:35.319474 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.320552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.321320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.321780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.447224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:35.455404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:35.457417 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:35.458594 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcf2d6c1-b822-4a13-8357-ae3671a1f379 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.149882 Nov 23 10:21:35.459152 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 365/707] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:35 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:35.646653 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:35.647260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:35.653317 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.653785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.654549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:35.654978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:35.782809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:35.790177 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d64742d4-68ee-47fb-bb8c-43ec9044ae92 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.147874 Nov 23 10:21:35.790749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 343/708] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:35 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:36.200444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:36.201255 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:36.207390 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.207862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:36.208635 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.209089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:36.239652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86229e0b-0d57-413f-be12-48add8c008e3 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Nov 23 10:21:36.240255 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 366/709] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:36 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:36.477872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:36.478716 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:36.485580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.486564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:36.487529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.488134 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:36.620865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:36.628874 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:36.630866 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:36.632077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abe3b52a-affb-4717-873b-ef2721d6da87 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.158944 Nov 23 10:21:36.632870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 344/710] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:36 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:36.807452 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:36.808787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:36.815074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.815605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:36.816485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:36.817440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:37.179605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:37.186834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12b05f41-6feb-40dc-865d-31dde8cf69f2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.383418 Nov 23 10:21:37.187421 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 367/711] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:36 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:37.251170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:37.252108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:37.258399 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:37.258848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:37.259607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:37.260038 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:37.289388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ba2d9a7e-4ad6-48a5-91c5-8630521d547e tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Nov 23 10:21:37.289991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 345/712] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:37 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:21:37.650215 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:37.651299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:37.665296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:37.665784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:37.666590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:37.667030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:37.798744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:37.807314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:37.808798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:37.809962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f9d4aa4-bad9-4013-ba94-9a2cc73eb8d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.163335 Nov 23 10:21:37.810522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 368/713] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:37 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:37.998532 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-4301b26a-25b7-4287-be73-fc15d4589ae2 req-bd10d029-7946-4f7d-9b49-cc451ee16c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "name": "network-vif-plugged", "status": "completed", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:38.004870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:38.004870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:38.013342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4301b26a-25b7-4287-be73-fc15d4589ae2 req-bd10d029-7946-4f7d-9b49-cc451ee16c01 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.013852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4301b26a-25b7-4287-be73-fc15d4589ae2 req-bd10d029-7946-4f7d-9b49-cc451ee16c01 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.027514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-4301b26a-25b7-4287-be73-fc15d4589ae2 req-bd10d029-7946-4f7d-9b49-cc451ee16c01 service nova] Creating event network-vif-plugged:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:21:38.033239 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-4301b26a-25b7-4287-be73-fc15d4589ae2 req-bd10d029-7946-4f7d-9b49-cc451ee16c01 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Nov 23 10:21:38.034299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 346/714] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:38.203737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:38.204861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:38.211850 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.212543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.213137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.213965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.302049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:38.302816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:38.308978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.309458 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.310250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.310687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.340863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2ebcc7c-84bb-4b22-b855-a645bad391eb tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044136 Nov 23 10:21:38.341435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 347/715] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:21:38 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:21:38.362952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:38.371020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d04bdbc-d89a-4b8b-b5de-25edc7eeb5a9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.171218 Nov 23 10:21:38.371633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 369/716] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:38 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:38.828372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:38.828890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:38.835826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.836256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.837213 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:38.837644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:38.971456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:38.979629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:38.981103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:38.982268 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3fbdbcf2-3933-4db2-a58e-f2f1bae0c49f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.157730 Nov 23 10:21:38.982829 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 348/717] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:38 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:39.387548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:39.388184 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:39.394730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:39.395173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:39.395946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:39.396376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:39.529666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:39.537856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fb867289-7c4f-4566-9a2d-66db3086a86d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.153541 Nov 23 10:21:39.538355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 370/718] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:39 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:40.000687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:40.001475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:40.008397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:40.008956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:40.009809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:40.010239 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:40.141528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:40.150246 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:40.151721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:40.152891 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-023cb369-e404-48e1-b015-74236ba4f0ef tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.156298 Nov 23 10:21:40.153456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 349/719] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:39 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:40.554644 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:40.555857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:40.561402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:40.561900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:40.562687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:40.563125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:40.696235 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:40.703428 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c155b415-7dd2-44c6-bfdc-afa861a92a95 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.152770 Nov 23 10:21:40.703984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 371/720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:40 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:41.171790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:41.172573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:41.179523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:41.179975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:41.180753 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:41.181189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:41.312050 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:41.320329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:41.321852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:41.323011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a960e1bc-8c7d-4e4a-81db-21b1ac778310 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.154999 Nov 23 10:21:41.323576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 350/721] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:41 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:41.721835 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:41.723412 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:41.731170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:41.731621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:41.734297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:41.734747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:41.881632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:41.890651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7b5b017-ce0e-4f68-b91e-27834c8f2253 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.174229 Nov 23 10:21:41.891229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 372/722] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:41 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:42.341157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:42.341847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:42.348022 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.348463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.349920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.350402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.480428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:42.488656 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:42.490292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:42.491441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a3e227ce-b087-422d-997e-7fdc108dbd92 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.153976 Nov 23 10:21:42.492047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 351/723] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:42 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:42.741231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:42.741753 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:42.747894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.748332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.749096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.749521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.773917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:21:42.846604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96c272f8-b1d0-4ae1-9475-882b40c9e6c8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 204 len: 0 microversion: 2.1 time: 0.108651 Nov 23 10:21:42.847200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 373/724] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:21:42 2021] DELETE /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:21:42.854796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:42.855340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:42.861116 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.861544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.862346 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.862781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.907776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:42.908474 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:42.914790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.915236 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:42.916026 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:42.916459 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:43.054356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:43.061856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-322937a2-86d0-46b8-87ec-6d2314fd4f7e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.157972 Nov 23 10:21:43.062442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 374/725] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:42 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:43.206062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:43.213719 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-601711ff-cf29-4dfb-a1c0-7433bcccbbe7 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.362516 Nov 23 10:21:43.214286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 352/726] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:42 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:43.509719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:43.510352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:43.516306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:43.516758 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:43.517532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:43.517999 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:43.651987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:43.660057 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:43.661569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:43.663004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c68f15e8-1375-4e26-993c-4ffc38f7d149 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.157846 Nov 23 10:21:43.663563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 375/727] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:43 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:44.078377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:44.079026 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:44.085419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.085913 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.086700 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.087139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.214075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:44.221957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f663a37f-49b0-4181-9112-65eed2f45f0c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.146879 Nov 23 10:21:44.222539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 353/728] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:44 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:44.230470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:44.231037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:44.237200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.237621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.238413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.238843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.365218 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:44.372453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c51f1150-fe7d-4524-b487-2e545d4c02ab tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.145637 Nov 23 10:21:44.373026 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 376/729] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:44 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:44.680932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:44.681456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:44.687482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.687947 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.688698 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:44.689127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:44.826372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:44.835142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:44.838456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:44.838456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4b791bf-3bd5-4ae5-ae1b-cc1b1a83b6f9 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.160658 Nov 23 10:21:44.838456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 354/730] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:44 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:45.239832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:45.240442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:45.246817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.247250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:45.248027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.248460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:45.378022 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:45.385910 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fdff24c4-6570-4537-9816-65590aa4fe50 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.150281 Nov 23 10:21:45.386478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 377/731] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:45 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:45.388130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:45.388748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:45.394918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.395360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:45.396369 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.396567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:45.521048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:45.528633 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-187b0680-2ade-40e7-a71c-ac3817506aa5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.144206 Nov 23 10:21:45.529205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 355/732] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:45 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:45.856664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:45.857292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:45.863431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.863952 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:45.864743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:45.865194 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.001733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:46.010021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:46.011494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:46.012638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df165496-ca31-4f49-ac39-ff57111d2d60 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.159829 Nov 23 10:21:46.013202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 378/733] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:45 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:46.086411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-93d91721-32b5-45c5-a438-cc43a062c580 req-e73fd9b2-9bd4-4e53-973f-3c08b7cc76d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "name": "network-vif-plugged", "status": "completed", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:46.088053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:46.088053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:46.100454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-93d91721-32b5-45c5-a438-cc43a062c580 req-e73fd9b2-9bd4-4e53-973f-3c08b7cc76d4 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:46.100454 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-93d91721-32b5-45c5-a438-cc43a062c580 req-e73fd9b2-9bd4-4e53-973f-3c08b7cc76d4 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.115114 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-93d91721-32b5-45c5-a438-cc43a062c580 req-e73fd9b2-9bd4-4e53-973f-3c08b7cc76d4 service nova] Creating event network-vif-plugged:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:21:46.121295 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-93d91721-32b5-45c5-a438-cc43a062c580 req-e73fd9b2-9bd4-4e53-973f-3c08b7cc76d4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039400 Nov 23 10:21:46.122165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 356/734] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:46.402610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:46.403125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:46.409401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:46.409891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.410676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:46.411784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.549559 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:46.551505 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:46.559605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:46.560329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.561593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:46.562139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:46.565120 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:46.574820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c50aeb7d-a61b-4a6c-9013-3ee2b1882763 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.175947 Nov 23 10:21:46.575713 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 379/735] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:46 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:46.724575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:46.731880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d868254-47cf-47e8-9fe0-33c06bc28cc9 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.187998 Nov 23 10:21:46.732448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 357/736] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:46 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:47.032511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:47.033213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:47.040531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.041087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.043566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.043566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.208160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:47.217095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:47.218942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:47.220291 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-307b7e46-40e6-4c4e-b90f-5ba57013c556 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1807 microversion: 2.20 time: 0.192902 Nov 23 10:21:47.234551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 380/737] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:47 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:21:47.592294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:47.592988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:47.600261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.600703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.601476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.602075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.742731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:47.749078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:47.749917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:47.750034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-82b45fec-fedf-4f91-8927-f88c5e307914 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1261 microversion: 2.1 time: 0.161312 Nov 23 10:21:47.750550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 358/738] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:47 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:47.756682 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.757126 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.757935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:47.758374 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:47.897161 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:47.904924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4af0c6d8-4859-4c54-a6f7-ce95003c791f tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.159423 Nov 23 10:21:47.905511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 381/739] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:47 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:48.244206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:48.244930 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:48.250668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.251179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.252069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.257906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.403939 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:48.413918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:48.415941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:48.417827 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42ad29e9-d91f-4a9d-90fc-57ea9f7a201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1794 microversion: 2.20 time: 0.177214 Nov 23 10:21:48.418797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 359/740] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:21:48 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:21:48.767332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:48.768020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:48.774328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.774787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.775577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.776013 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.908963 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:48.917024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc797825-ea6b-400d-a997-56bfae08a443 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1446 microversion: 2.1 time: 0.153527 Nov 23 10:21:48.917590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 382/741] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:48 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:48.923859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:48.924562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:48.931087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.931529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.932301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.932436 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:48.932732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.933048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:48.938740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.939185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:48.939961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:48.940391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:49.062038 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:49.069579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d91286c0-02fa-454d-9c37-c72b6f47eefa tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.149236 Nov 23 10:21:49.069769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:49.070213 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 360/742] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:48 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:49.077008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9667e3e3-f273-49ec-a8e6-b4fe09cad151 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1446 microversion: 2.1 time: 0.148089 Nov 23 10:21:49.077568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 383/743] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:48 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:49.401189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:49.401790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:49.407740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:49.408185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:49.408965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:49.409397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:49.491661 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lazy-loading 'services' on Instance uuid c30a1ebf-90a9-41e9-b3c4-4acade4f386f {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:21:49.573077 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a93a402-0457-4607-99a6-cdcc29419087 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f/os-volume_attachments/597acb01-abb0-4993-b6f1-40d91de0d058" status: 202 len: 0 microversion: 2.1 time: 0.174858 Nov 23 10:21:49.573820 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 361/744] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:21:49 2021] DELETE /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f/os-volume_attachments/597acb01-abb0-4993-b6f1-40d91de0d058 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:21:50.087059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:50.087611 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:50.093738 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.094216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.094982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.095411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.321580 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:50.337481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5201a456-bea1-4ce1-9752-ba3aa3ee1682 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1506 microversion: 2.1 time: 0.254532 Nov 23 10:21:50.338389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 384/745] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:50 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:50.710314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:50.710862 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:50.722051 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.723152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.739593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.739593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.749568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c80237d9-0019-4891-991f-7077212b4e92 req-56b69332-0358-47ba-8580-c3597679d852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba8eea4-a0f8-43c3-9155-9cefef7d797a", "name": "network-vif-deleted", "tag": "570571b8-550d-4a67-b91e-43500cd97022"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:50.751287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:50.751287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:21:50.767462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c80237d9-0019-4891-991f-7077212b4e92 req-56b69332-0358-47ba-8580-c3597679d852 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.768214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c80237d9-0019-4891-991f-7077212b4e92 req-56b69332-0358-47ba-8580-c3597679d852 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.785405 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c80237d9-0019-4891-991f-7077212b4e92 req-56b69332-0358-47ba-8580-c3597679d852 service nova] Creating event network-vif-deleted:570571b8-550d-4a67-b91e-43500cd97022 for instance 7ba8eea4-a0f8-43c3-9155-9cefef7d797a on hv-cinder-80403 Nov 23 10:21:50.793627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c80237d9-0019-4891-991f-7077212b4e92 req-56b69332-0358-47ba-8580-c3597679d852 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046866 Nov 23 10:21:50.794858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 385/746] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:50.809079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:21:50.948956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-91e32b46-9416-4145-8e2e-8ad0c5f94210 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 204 len: 0 microversion: 2.1 time: 0.243046 Nov 23 10:21:50.949646 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 362/747] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:21:50 2021] DELETE /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:21:50.961847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:50.962613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:50.975051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.975551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:50.976760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:50.977233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:51.262447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:51.281355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a11a1c6-f312-4909-94e5-156b040c3c9a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1513 microversion: 2.1 time: 0.326061 Nov 23 10:21:51.283239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 386/748] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:50 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1513 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:51.333210 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-7a23cda5-d71e-4a9d-aa36-1bf72e4bb4e1 req-5e08467d-f154-4d91-904f-bf8eb4fdc7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:51.334846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:51.334846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:51.342166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-7a23cda5-d71e-4a9d-aa36-1bf72e4bb4e1 req-5e08467d-f154-4d91-904f-bf8eb4fdc7da service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:51.342687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-7a23cda5-d71e-4a9d-aa36-1bf72e4bb4e1 req-5e08467d-f154-4d91-904f-bf8eb4fdc7da service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:51.353969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:51.354634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:51.359803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-7a23cda5-d71e-4a9d-aa36-1bf72e4bb4e1 req-5e08467d-f154-4d91-904f-bf8eb4fdc7da service nova] Creating event network-changed:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:21:51.361500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:51.362239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:51.363040 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:51.363532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:51.367175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-7a23cda5-d71e-4a9d-aa36-1bf72e4bb4e1 req-5e08467d-f154-4d91-904f-bf8eb4fdc7da service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037845 Nov 23 10:21:51.368092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 363/749] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:51.403123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:51.403478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:51.403934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lazy-loading 'fault' on Instance uuid 7ba8eea4-a0f8-43c3-9155-9cefef7d797a {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:21:51.451234 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:51.461206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79771904-645b-4f9a-a3af-634d915f609c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 200 len: 1311 microversion: 2.1 time: 0.110760 Nov 23 10:21:51.465929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 387/750] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:51 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:21:52.302411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:52.303511 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:52.310736 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.311179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.311961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.312386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.452765 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:52.460621 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3ff6ee3-032c-4566-acd5-9deaec8414a5 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1513 microversion: 2.1 time: 0.163797 Nov 23 10:21:52.461444 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 364/751] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:52 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:52.486913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:52.487711 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: 7ba8eea4-a0f8-43c3-9155-9cefef7d797a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:52.495939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.496382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.497162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.497587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.511180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] HTTP exception thrown: Instance 7ba8eea4-a0f8-43c3-9155-9cefef7d797a could not be found. Nov 23 10:21:52.511762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Returning 404 to user: Instance 7ba8eea4-a0f8-43c3-9155-9cefef7d797a could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:52.512584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c71b0185-a316-4c95-90dd-5a79bf70c1d4 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a" status: 404 len: 111 microversion: 2.1 time: 0.030093 Nov 23 10:21:52.513181 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 388/752] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:52 2021] GET /compute/v2.1/servers/7ba8eea4-a0f8-43c3-9155-9cefef7d797a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 10:21:52.520720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:52.521203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:52.527048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.527487 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.528243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.528671 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.553555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:21:52.623606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55513e04-bc05-4427-985b-3f72db3f9d9c tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 204 len: 0 microversion: 2.1 time: 0.106183 Nov 23 10:21:52.624193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 365/753] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:21:52 2021] DELETE /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:21:52.632328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:52.633327 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:52.640415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.640861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.641803 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:52.642238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:52.769230 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:52.776873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-699d0734-85f4-44d5-8abf-ff0af3f939b5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.148614 Nov 23 10:21:52.777433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 389/754] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:52 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:53.478229 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:53.478917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:53.485300 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:53.485842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:53.486835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:53.487509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:53.701607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d9c8d8f04c4ff6a12bc1b1645f09aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a5a3020ea46dfb81f427e8c9f0163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:53.709080 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e03ca2b-f8e2-4e91-a480-a947d27f5eb3 tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 200 len: 1513 microversion: 2.1 time: 0.234974 Nov 23 10:21:53.710357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 366/755] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:53 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:53.795391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:53.796000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:53.802925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:53.803368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:53.804155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:53.804589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:53.935479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:53.945313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bc52c03-9dec-4faf-a406-a10d5b73d269 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.153348 Nov 23 10:21:53.946648 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 390/756] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:53 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:54.026175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-342e3738-8a59-4df2-974c-fd260bc7c45c req-3bbac3c4-7322-4fd6-b127-9b7bf85732dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30a1ebf-90a9-41e9-b3c4-4acade4f386f", "name": "network-vif-deleted", "tag": "3719ef05-a5c5-4edb-a934-e7201effed22"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:21:54.027657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:21:54.027657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:21:54.039003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-342e3738-8a59-4df2-974c-fd260bc7c45c req-3bbac3c4-7322-4fd6-b127-9b7bf85732dd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:54.039446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-342e3738-8a59-4df2-974c-fd260bc7c45c req-3bbac3c4-7322-4fd6-b127-9b7bf85732dd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:54.050262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-342e3738-8a59-4df2-974c-fd260bc7c45c req-3bbac3c4-7322-4fd6-b127-9b7bf85732dd service nova] Creating event network-vif-deleted:3719ef05-a5c5-4edb-a934-e7201effed22 for instance c30a1ebf-90a9-41e9-b3c4-4acade4f386f on hv-cinder-80403 Nov 23 10:21:54.056052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-342e3738-8a59-4df2-974c-fd260bc7c45c req-3bbac3c4-7322-4fd6-b127-9b7bf85732dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Nov 23 10:21:54.056618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 367/757] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:21:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:21:54.727168 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:54.727814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] [instance: c30a1ebf-90a9-41e9-b3c4-4acade4f386f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:54.734481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:54.734933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:54.735723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:54.736162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:54.750629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] HTTP exception thrown: Instance c30a1ebf-90a9-41e9-b3c4-4acade4f386f could not be found. Nov 23 10:21:54.751740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] Returning 404 to user: Instance c30a1ebf-90a9-41e9-b3c4-4acade4f386f could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:21:54.752721 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7bc4617b-857c-4f0c-8370-9ab26bccf69a tempest-VolumesSnapshotTestJSON-1248404867 tempest-VolumesSnapshotTestJSON-1248404867-project] 10.222.0.41 "GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f" status: 404 len: 111 microversion: 2.1 time: 0.029682 Nov 23 10:21:54.753343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 391/758] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:54 2021] GET /compute/v2.1/servers/c30a1ebf-90a9-41e9-b3c4-4acade4f386f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:21:54.967441 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:54.968275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:54.975253 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:54.975782 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:54.976702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:54.977211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:55.110678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:55.117899 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f952665d-0cab-4b79-8012-379e89445974 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.158266 Nov 23 10:21:55.118469 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 368/759] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:54 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:56.138675 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:56.139307 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:56.145993 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:56.146446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:56.147233 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:56.147676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:56.282062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:56.290547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b793987a-0ac5-43ad-ae7d-25435c087ca8 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.155456 Nov 23 10:21:56.291128 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 392/760] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:56 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:57.313119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:57.313864 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:57.320299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:57.320742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:57.321501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:57.321956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:57.449239 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:57.456658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c5c4aa97-2d90-4e84-b911-62ec821e5d26 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.147135 Nov 23 10:21:57.457223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 369/761] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:57 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:58.474283 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:58.475304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:58.481163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:58.481608 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:58.482398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:58.482831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:58.619699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:58.626887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78668214-38bc-4a0c-aa57-693f04de0913 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.156818 Nov 23 10:21:58.627444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 393/762] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:58 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:21:59.643970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:21:59.644518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:21:59.650734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:59.651175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:59.651938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:21:59.652363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:21:59.784699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:21:59.793105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f8acae74-9dcc-499b-80d5-0b0ac6630937 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.153203 Nov 23 10:21:59.793760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 370/763] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:21:59 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:00.810165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:00.810724 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:00.817443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:00.817925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:00.818689 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:00.819118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:00.947481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:00.955161 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b6fc4f1-51ab-4bfb-920d-67abb5ec7ce5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.148735 Nov 23 10:22:00.955725 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 394/764] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:00 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:01.972139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:01.972751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:01.979522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:01.979961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:01.980720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:01.981148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:02.115344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:02.122624 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5efd754-4f8e-41a2-b172-d4633d4797c5 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.154461 Nov 23 10:22:02.123198 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 371/765] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:01 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:03.139948 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:03.140552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:03.147450 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:03.147898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:03.148672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:03.149110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:03.294829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:03.304328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7fa7a0d0-56fd-4432-b8ad-56bd1c104951 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1520 microversion: 2.1 time: 0.167852 Nov 23 10:22:03.305516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 395/766] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:03 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:04.276154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-ead05b14-09e5-44be-b91b-f3fc321a9a1b req-c2514f9d-fe2a-4d19-b60a-a4bf9279f12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe7ef11-1dd1-496b-b4d6-de2f5505c8dc", "name": "network-vif-deleted", "tag": "94947f42-bd0e-4ff1-b742-0ca7ed6801ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:04.277942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:22:04.277942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:22:04.286395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ead05b14-09e5-44be-b91b-f3fc321a9a1b req-c2514f9d-fe2a-4d19-b60a-a4bf9279f12d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:04.286841 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ead05b14-09e5-44be-b91b-f3fc321a9a1b req-c2514f9d-fe2a-4d19-b60a-a4bf9279f12d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:04.298359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-ead05b14-09e5-44be-b91b-f3fc321a9a1b req-c2514f9d-fe2a-4d19-b60a-a4bf9279f12d service nova] Creating event network-vif-deleted:94947f42-bd0e-4ff1-b742-0ca7ed6801ac for instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc on hv-cinder-80403 Nov 23 10:22:04.303969 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-ead05b14-09e5-44be-b91b-f3fc321a9a1b req-c2514f9d-fe2a-4d19-b60a-a4bf9279f12d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Nov 23 10:22:04.304920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 372/767] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:22:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:22:04.326814 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:04.327422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:04.333783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:04.334231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:04.335006 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:04.335441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:04.394075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:04.401342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cab50bbd-38ac-4709-8c5e-6226a4705aed tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1478 microversion: 2.1 time: 0.078291 Nov 23 10:22:04.401954 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 396/768] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:04 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1478 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:05.419565 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:05.420270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:05.427059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:05.427507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:05.428281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:05.428718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:05.487163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:05.495069 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c5b3eca-c888-47eb-87d6-166cff84da76 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1306 microversion: 2.1 time: 0.079944 Nov 23 10:22:05.495648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 373/769] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:05 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1306 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:06.511522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:06.512148 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:06.518333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:06.518777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:06.519544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:06.520643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:06.591572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8343a33a2e4078b46569105f4a38ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b2327a81643d9a2ca87a6f5ba3daa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:06.599391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d65deb2-4773-4be5-813c-68a9b7e7d351 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 200 len: 1306 microversion: 2.1 time: 0.091398 Nov 23 10:22:06.599984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 397/770] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:06 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:07.615294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:07.615894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] [instance: afe7ef11-1dd1-496b-b4d6-de2f5505c8dc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:07.624402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:07.624855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:07.625650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:07.626108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:07.644571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] HTTP exception thrown: Instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc could not be found. Nov 23 10:22:07.645587 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] Returning 404 to user: Instance afe7ef11-1dd1-496b-b4d6-de2f5505c8dc could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:22:07.646453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a1bb36b9-5f83-499a-91c1-232ae2a1f005 tempest-ServerRescueNegativeTestJSON-362582780 tempest-ServerRescueNegativeTestJSON-362582780-project] 10.222.0.41 "GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc" status: 404 len: 111 microversion: 2.1 time: 0.034946 Nov 23 10:22:07.647026 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 374/771] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:07 2021] GET /compute/v2.1/servers/afe7ef11-1dd1-496b-b4d6-de2f5505c8dc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:22:16.932461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: .version_select at 0x7f9fd77758b0>, body: {"keypair": {"name": "tempest-keypair-604744706"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:16.954302 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:22:16.958938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:22:17.229124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:22:17.233087 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:22:17.247356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-756040b7-03e7-424f-8382-90072e0ea442 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.451364 Nov 23 10:22:17.248199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 398/772] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 23 10:22:16 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:18.639842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1077303012", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6acff799-0077-4cd7-98c9-c8248982bc45"}], "security_groups": [{"name": "tempest-securitygroup--93591419"}], "key_name": "tempest-keypair-604744706", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:18.759045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] validate_networks() for [('6acff799-0077-4cd7-98c9-c8248982bc45', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:22:19.230204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:22:19.230620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:22:19.231089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:22:19.231486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:22:19.231888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:22:19.242367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:19.242832 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:19.243819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:19.244414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:19.262320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:22:19.266654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:22:19.278221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:22:19.280653 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:22:19.345982 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18ec0507-90bb-4d31-8af7-4d1396438b60 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.710380 Nov 23 10:22:19.349062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 375/773] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:22:18 2021] POST /compute/v2.1/servers => generated 400 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:22:19.358845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cacdf175-991a-4c80-b259-b7f78441d2d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:19.359458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cacdf175-991a-4c80-b259-b7f78441d2d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:19.439138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cacdf175-991a-4c80-b259-b7f78441d2d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:19.450238 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cacdf175-991a-4c80-b259-b7f78441d2d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1237 microversion: 2.1 time: 0.094369 Nov 23 10:22:19.451394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 399/774] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:19 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:20.468237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:20.468925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:20.479332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:20.479773 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:20.480567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:20.481000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:20.565047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:20.576290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17961b3d-5d7b-4f3a-b7c9-6e9d2b75ee82 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1289 microversion: 2.1 time: 0.111753 Nov 23 10:22:20.577012 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 376/775] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:20 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:21.595239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:21.595842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:21.602486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:21.602877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:21.603665 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:21.604318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:21.784376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:21.793361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c10fa507-7756-41bb-8acf-fb80ded1cbc5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.201749 Nov 23 10:22:21.798089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 400/776] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:21 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:22.384560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-68d83313-fa55-4c25-824a-bb1371c66cbf req-42ffcc23-e4bc-4d59-9dc7-1ada8c0672c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7057a553-2d1e-42cd-871a-a866b56242da", "tag": "1ec010d3-ad72-4866-a7e5-09f4bc87f439"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:22.386934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:22:22.386934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:22:22.396016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-68d83313-fa55-4c25-824a-bb1371c66cbf req-42ffcc23-e4bc-4d59-9dc7-1ada8c0672c8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:22.396779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-68d83313-fa55-4c25-824a-bb1371c66cbf req-42ffcc23-e4bc-4d59-9dc7-1ada8c0672c8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:22.413811 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-68d83313-fa55-4c25-824a-bb1371c66cbf req-42ffcc23-e4bc-4d59-9dc7-1ada8c0672c8 service nova] Creating event network-changed:1ec010d3-ad72-4866-a7e5-09f4bc87f439 for instance 7057a553-2d1e-42cd-871a-a866b56242da on hv-cinder-80403 Nov 23 10:22:22.420684 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-68d83313-fa55-4c25-824a-bb1371c66cbf req-42ffcc23-e4bc-4d59-9dc7-1ada8c0672c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039613 Nov 23 10:22:22.421952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 377/777] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:22:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:22:22.812008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:22.812607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:22.819230 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:22.819667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:22.820451 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:22.820883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:22.977080 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:22.986709 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-283a1579-8baf-4316-9380-c308a191f5b9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.178253 Nov 23 10:22:22.987812 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 401/778] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:22 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:24.004558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:24.005365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:24.011844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:24.012289 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:24.013075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:24.013503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:24.219528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:24.231061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1434ff2-988c-4bb8-ad98-2354dfce332f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.229983 Nov 23 10:22:24.231612 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 378/779] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:23 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:25.249221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:25.250049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:25.260387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:25.261236 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:25.263565 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:25.264342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:25.493436 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:25.501063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc01e47f-4bee-4ccd-937c-0009c2f921ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.255593 Nov 23 10:22:25.511267 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 402/780] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:25 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:22:26.521807 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:26.522518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:26.530290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:26.530998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:26.532032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:26.532711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:26.700891 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:26.711052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1978605-d7bf-4c55-9578-38d222d216f2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.196386 Nov 23 10:22:26.711955 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 379/781] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:26 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:27.729344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:27.730273 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:27.736628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:27.737167 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:27.738631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:27.739150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:27.924819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:27.938906 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fcddc23-c219-4b0e-b248-e6df8334869b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.211568 Nov 23 10:22:27.940960 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 403/782] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:27 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:22:27.975906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-7e3d6e16-c156-45b5-9ee0-f8327940f372 req-4012a522-f264-4923-83b7-a5ac18cdcb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7057a553-2d1e-42cd-871a-a866b56242da", "name": "network-vif-plugged", "status": "completed", "tag": "1ec010d3-ad72-4866-a7e5-09f4bc87f439"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:27.977408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:22:27.977408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:22:27.985256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-7e3d6e16-c156-45b5-9ee0-f8327940f372 req-4012a522-f264-4923-83b7-a5ac18cdcb90 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:27.985982 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-7e3d6e16-c156-45b5-9ee0-f8327940f372 req-4012a522-f264-4923-83b7-a5ac18cdcb90 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:28.001740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-7e3d6e16-c156-45b5-9ee0-f8327940f372 req-4012a522-f264-4923-83b7-a5ac18cdcb90 service nova] Creating event network-vif-plugged:1ec010d3-ad72-4866-a7e5-09f4bc87f439 for instance 7057a553-2d1e-42cd-871a-a866b56242da on hv-cinder-80403 Nov 23 10:22:28.007942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-7e3d6e16-c156-45b5-9ee0-f8327940f372 req-4012a522-f264-4923-83b7-a5ac18cdcb90 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035860 Nov 23 10:22:28.008932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 380/783] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:22:28.958237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:28.958931 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:28.965314 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:28.965873 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:28.967274 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:28.967274 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:29.155946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:29.169432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d8a174b-f1c6-474b-a6a9-5592ef492eeb tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1361 microversion: 2.1 time: 0.215450 Nov 23 10:22:29.170156 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 404/784] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:28 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:30.187775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:30.188484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:30.198511 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:30.199198 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:30.200232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:30.200916 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:30.363315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:30.372042 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-46f18006-5ec1-48f7-92f0-543032ea8411 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1547 microversion: 2.1 time: 0.188603 Nov 23 10:22:30.372573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 381/785] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:22:30 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:22:30.396934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:30.396934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:30.397784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:30.398253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:30.398967 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:30.399397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:30.492556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98abf538-6995-4b88-9783-7162ebcdb41f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106861 Nov 23 10:22:30.493311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 405/786] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 23 10:22:30 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:22:32.037169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:32.043100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-9b147ee2-1599-46ae-8aa1-fbc11dd9bd3e req-a8ab46d1-6a80-41ed-a13f-e6a8b4c1bd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7057a553-2d1e-42cd-871a-a866b56242da", "tag": "1ec010d3-ad72-4866-a7e5-09f4bc87f439"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:32.045262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:22:32.045262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:22:32.046257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:32.057048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:32.059517 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:32.060725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:32.062811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9b147ee2-1599-46ae-8aa1-fbc11dd9bd3e req-a8ab46d1-6a80-41ed-a13f-e6a8b4c1bd3a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:32.063356 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9b147ee2-1599-46ae-8aa1-fbc11dd9bd3e req-a8ab46d1-6a80-41ed-a13f-e6a8b4c1bd3a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:32.067304 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:32.087857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-9b147ee2-1599-46ae-8aa1-fbc11dd9bd3e req-a8ab46d1-6a80-41ed-a13f-e6a8b4c1bd3a service nova] Creating event network-changed:1ec010d3-ad72-4866-a7e5-09f4bc87f439 for instance 7057a553-2d1e-42cd-871a-a866b56242da on hv-cinder-80403 Nov 23 10:22:32.094421 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-9b147ee2-1599-46ae-8aa1-fbc11dd9bd3e req-a8ab46d1-6a80-41ed-a13f-e6a8b4c1bd3a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053382 Nov 23 10:22:32.101351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 406/787] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:22:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:22:34.522230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07eeeb5a-8ee2-4a87-b113-d50edcab445e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 2.489429 Nov 23 10:22:34.523772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 382/788] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:32 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:35.534278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:35.535813 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:35.542721 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:35.543069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:35.543891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:35.544330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:35.620612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b6510dd-9380-430d-8447-a387f831811e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.090270 Nov 23 10:22:35.621524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 407/789] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:35 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:36.633466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:36.634684 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:36.643171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:36.643708 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:36.645291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:36.645873 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:36.718767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-566bf8aa-71ca-459a-829a-4229a17a9943 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.089221 Nov 23 10:22:36.719397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 383/790] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:36 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:37.730578 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:37.732291 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:37.741412 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:37.742107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:37.742888 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:37.743319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:37.826677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-461ac19b-6b12-4bdc-98f8-d79509489e2b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.100087 Nov 23 10:22:37.830744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 408/791] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:37 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:38.842206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:38.844102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:38.852110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:38.852923 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:38.854131 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:38.854932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:38.962037 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-499767be-ed33-4f4f-902e-93010b191a83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.125522 Nov 23 10:22:38.963118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 384/792] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:38 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:39.982229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:39.984297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:39.993408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:39.993899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:39.994723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:39.995361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:40.077470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3aafa08-d21f-4cb5-be9a-d2396f258402 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.100766 Nov 23 10:22:40.078527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 409/793] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:39 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:41.089174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:41.090996 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:41.099048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:41.099749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:41.100778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:41.101421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:41.180748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5cb6e8c3-91a1-47e0-9578-d2649630f144 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.095562 Nov 23 10:22:41.183572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 385/794] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:41 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:42.200514 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:42.202996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:42.211622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:42.212394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:42.213953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:42.214419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:42.297431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-172bbd19-d4e8-41a0-9bb6-62862fdcbf42 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.103444 Nov 23 10:22:42.298118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 410/795] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:42 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:22:43.317052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:43.320932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:43.337749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:43.338187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:43.339040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:43.339420 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:43.435314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-303d3185-c811-40ce-acd8-2514233eef03 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 14 microversion: 2.1 time: 0.126364 Nov 23 10:22:43.438218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 386/796] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:43 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:22:44.474379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:44.477321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:44.499945 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:44.500375 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:44.504904 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:44.505670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:44.628562 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c10bd291-371d-4d30-9fe9-6e60c722c991 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 8749 microversion: 2.1 time: 0.177397 Nov 23 10:22:44.631221 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 411/797] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:44 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 8749 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:22:45.646087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:45.649806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:45.668918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:45.670062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:45.670772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:45.671614 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:45.789298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0e97f11-5506-46ec-9c8e-eda332ee52c1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 15025 microversion: 2.1 time: 0.149103 Nov 23 10:22:45.791754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 387/798] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:45 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 15025 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:46.803302 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:46.804227 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:46.813004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:46.813659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:46.820063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:46.820518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:46.950983 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-efd11d9d-b1e1-434f-a7c4-65b3b984790d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 18030 microversion: 2.1 time: 0.151167 Nov 23 10:22:46.951892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 412/799] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:46 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 18030 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:47.089150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:47.090004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:47.104434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.108755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:47.110534 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.110983 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:47.181099 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c00bb8cb-3df1-442c-ac69-e16e9dd964a8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments/5d9cd580-d793-4880-a60a-39beb6f1173f" status: 200 len: 194 microversion: 2.20 time: 0.095689 Nov 23 10:22:47.191053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 388/800] 10.222.0.41 () {60 vars in 1453 bytes} [Tue Nov 23 10:22:47 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments/5d9cd580-d793-4880-a60a-39beb6f1173f => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:47.306896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:47.307856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:47.329846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.332050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:47.333795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.334422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:47.949796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lazy-loading 'services' on Instance uuid b6188ff0-e2b2-4465-a6c9-68b77464d49e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:22:47.964088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:47.965266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:47.972589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.973645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:47.974920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:47.990493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:48.079669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e26716c0-f7a1-4e24-b8ed-24907e8c1def tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments/5d9cd580-d793-4880-a60a-39beb6f1173f" status: 202 len: 0 microversion: 2.20 time: 0.780565 Nov 23 10:22:48.081237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 413/801] 10.222.0.41 () {60 vars in 1456 bytes} [Tue Nov 23 10:22:47 2021] DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments/5d9cd580-d793-4880-a60a-39beb6f1173f => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:22:48.108887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:48.112702 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:48.122979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:48.123592 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:48.124571 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:48.125256 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:48.131792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-796d85e2-9136-470f-92c5-5cc98e83ca3d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 19024 microversion: 2.1 time: 0.171115 Nov 23 10:22:48.135556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 389/802] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:47 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 19024 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:22:48.163919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8398e467-f703-438d-bbed-e16776e7a197 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061917 Nov 23 10:22:48.164627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 414/803] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 23 10:22:48 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:49.145878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:49.153191 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:49.177988 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:49.180043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:49.187898 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.189040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.192919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.193855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.194582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.197417 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.199862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.201918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.283282 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5150cba6-2fd5-4aaf-836e-3c13a1cd73d1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.110346 Nov 23 10:22:49.284699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 415/804] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 23 10:22:49 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:22:49.353028 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3091de6b-715e-433d-9f96-5464fca3a9e0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 21344 microversion: 2.1 time: 0.212890 Nov 23 10:22:49.355960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 390/805] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:49 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 21344 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:22:49.414579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:49.417045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:49.433199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.433770 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.434893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.441426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.491594 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:22:49.664840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5a5c290-980a-4cfa-afd1-9a16550d5391 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 204 len: 0 microversion: 2.20 time: 0.256536 Nov 23 10:22:49.666473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 416/806] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 23 10:22:49 2021] DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 10:22:49.695179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:49.696877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:49.714352 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.715530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:49.717193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:49.718264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:50.298247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:50.317250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:50.321379 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:50.323112 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e082de9-03ff-465b-93db-0352c36ea3f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.649405 Nov 23 10:22:50.337407 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 391/807] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:22:49 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:22:50.373551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:50.383140 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:50.398202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:50.402857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:50.404064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:50.404748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:50.520683 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dde4a07c-e3ea-459e-ad76-42e28f3b6d83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 22981 microversion: 2.1 time: 0.155254 Nov 23 10:22:50.523772 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 417/808] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:50 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 22981 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:51.348314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:51.349479 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:51.372610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:51.374521 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:51.378852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:51.385644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:51.539615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:51.541272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:51.560874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:51.562064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:51.563407 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:51.564329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:51.732700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b2994b39-79f0-4dcb-b23b-ff8c92dacac6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 23804 microversion: 2.1 time: 0.200205 Nov 23 10:22:51.740263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 418/809] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:51 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 23804 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:22:51.801743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:22:51.802315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:22:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:22:51.903229 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:51.932406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:51.935480 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:51.938443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-536dbfbf-6c0f-448d-8a2b-a724d633b938 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1722 microversion: 2.20 time: 0.596913 Nov 23 10:22:51.944554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 392/810] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:22:51 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1722 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:22:52.755722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:52.759769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:52.796622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:52.797555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:52.798690 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:52.799957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:52.926612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99dcf13b-7cf3-495f-977f-ccae39fd5e0a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 25302 microversion: 2.1 time: 0.181653 Nov 23 10:22:52.931035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 419/811] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:52 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 25302 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:52.965299 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:52.966132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:52.984113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:52.984570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:52.985678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:52.986378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:53.800315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:53.813627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:53.816393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:53.819884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1994fcb1-2117-4688-8b66-3ec960e9fb07 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1655 microversion: 2.20 time: 0.856230 Nov 23 10:22:53.833724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 393/812] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:22:52 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1655 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:22:53.941486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:53.945593 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:53.955324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:53.956601 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:53.957604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:53.958244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:54.051552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8cbb01da-4d65-4871-933d-e0b27ac68651 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 26467 microversion: 2.1 time: 0.114542 Nov 23 10:22:54.055817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 420/813] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:53 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 26467 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:54.205031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e05e30b6-4f35-4883-86c0-d3178465aee6 req-21079de1-8eb4-490f-ab26-9a1a206f0806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6188ff0-e2b2-4465-a6c9-68b77464d49e", "name": "network-vif-deleted", "tag": "bb32b303-bfaf-46d7-89a4-d7457b4e60fb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:54.211598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:22:54.211598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:22:54.234204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e05e30b6-4f35-4883-86c0-d3178465aee6 req-21079de1-8eb4-490f-ab26-9a1a206f0806 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:54.234917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e05e30b6-4f35-4883-86c0-d3178465aee6 req-21079de1-8eb4-490f-ab26-9a1a206f0806 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:54.254868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e05e30b6-4f35-4883-86c0-d3178465aee6 req-21079de1-8eb4-490f-ab26-9a1a206f0806 service nova] Creating event network-vif-deleted:bb32b303-bfaf-46d7-89a4-d7457b4e60fb for instance b6188ff0-e2b2-4465-a6c9-68b77464d49e on hv-cinder-80403 Nov 23 10:22:54.277329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e05e30b6-4f35-4883-86c0-d3178465aee6 req-21079de1-8eb4-490f-ab26-9a1a206f0806 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081117 Nov 23 10:22:54.295404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 394/814] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:22:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:22:54.859224 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:54.860286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:54.887699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:54.889323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:54.896842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:54.896842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:54.999760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:55.003339 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:55.006398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lazy-loading 'fault' on Instance uuid b6188ff0-e2b2-4465-a6c9-68b77464d49e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:22:55.069279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:55.073275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:55.096277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:55.104558 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:55.109582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:55.111583 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:55.135003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:55.177074 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:55.186334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:22:55.191618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20466191-9cc3-410c-9c84-416aefaf572c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 200 len: 1371 microversion: 2.20 time: 0.340205 Nov 23 10:22:55.196961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 421/815] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:22:54 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:22:55.302354 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b385980d-9854-46af-81ad-2f41b22a3ac1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 27454 microversion: 2.1 time: 0.241692 Nov 23 10:22:55.304247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 395/816] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:55 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 27454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:56.226891 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:56.228404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:56.242843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:56.243626 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:56.244542 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:56.244987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:56.265061 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. Nov 23 10:22:56.273353 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:22:56.274656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-068b5070-c8e7-4529-ae3b-6e92c82afc8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 404 len: 111 microversion: 2.20 time: 0.051540 Nov 23 10:22:56.275240 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 422/817] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:22:56 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:22:56.320320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-63b175eb-f780-4473-9337-f2e942a40422 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '.version_select at 0x7f9fd7db60d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:22:56.343418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:56.345329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:56.356296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:56.357391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:56.359014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:56.361411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:56.495873 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-63b175eb-f780-4473-9337-f2e942a40422 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554836782" status: 204 len: 0 microversion: 2.20 time: 0.197318 Nov 23 10:22:56.515437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 396/818] 10.222.0.41 () {60 vars in 1258 bytes} [Tue Nov 23 10:22:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554836782 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 10:22:56.532624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4182f420-6da6-47ef-ac13-281094cd9eab tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 27890 microversion: 2.1 time: 0.214251 Nov 23 10:22:56.535430 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 423/819] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:56 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 27890 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:57.552777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:57.561344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:57.587634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:57.590973 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:57.596389 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:57.598932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:57.746608 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e49dfefe-1cf4-4205-9998-a8f01ef99553 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28183 microversion: 2.1 time: 0.200459 Nov 23 10:22:57.747294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 397/820] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:57 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:58.123755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: .version_select at 0x7f9fd7725670>, body: {"keypair": {"name": "tempest-keypair-980886696"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:58.143861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:22:58.148697 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:22:58.760649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:58.762847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:58.771925 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:22:58.776688 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:22:58.783858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:58.787483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:58.789681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:58.791214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:58.807595 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a95caf36-a1a0-4824-87f3-ca0fe2d3ad69 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.688704 Nov 23 10:22:58.829911 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 424/821] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Nov 23 10:22:58 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 711 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 10:22:58.917216 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f3fecc3c-a3e5-459b-bf10-a98fe69fda9b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28183 microversion: 2.1 time: 0.160382 Nov 23 10:22:58.917948 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 398/822] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:58 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:22:59.931078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:22:59.932165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:22:59.943820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:59.944285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:22:59.945455 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:22:59.945965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:00.081404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4920399-0492-4fe8-8db9-b49ccaa99ec6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28474 microversion: 2.1 time: 0.152125 Nov 23 10:23:00.087476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 425/823] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:22:59 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:01.097577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:01.099309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:01.116598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:01.119000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:01.121867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:01.122587 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:01.240338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea65ea7e-70ca-413e-872f-2ec5061aa77d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28642 microversion: 2.1 time: 0.147339 Nov 23 10:23:01.241660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 399/824] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:01 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28642 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:01.736485 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-527123358", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59babea3-a5f0-410b-9f8a-b0224f381b4f"}], "security_groups": [{"name": "tempest-securitygroup--2055608955"}], "key_name": "tempest-keypair-980886696", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:01.891447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] validate_networks() for [('59babea3-a5f0-410b-9f8a-b0224f381b4f', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:23:02.267657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:02.284524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:02.309747 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:02.310203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:02.311226 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:02.312237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:02.393327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66385107-2052-4f45-bb32-692f811ae48b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28642 microversion: 2.1 time: 0.139689 Nov 23 10:23:02.402903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 400/825] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:02 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28642 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:23:02.797138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:23:02.797972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:23:02.798150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:23:02.798558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:23:02.799808 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:23:02.812980 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:02.816169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:02.820460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:02.821286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:02.848065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for project 46bc019832e44730b73dbca94fd68096. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:23:02.857026 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Getting quotas for user a331bd5f38e14c048ea5d71df48d19a2 and project 46bc019832e44730b73dbca94fd68096. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:23:02.871857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:23:02.878139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:23:02.949000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8b5fa1b7-3257-48d3-944d-3d848f1a792e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.218960 Nov 23 10:23:02.958081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 426/826] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Nov 23 10:23:01 2021] POST /compute/v2.1/servers => generated 402 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 10:23:02.965450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:02.966560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:03.049984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:03.059704 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:03.062151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:03.063286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bcf22fbc-1e72-4e6b-9126-abf083c05b42 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1280 microversion: 2.20 time: 0.103788 Nov 23 10:23:03.063845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 401/827] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:02 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:03.416290 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:03.418496 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:03.428333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:03.429153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:03.430616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:03.431285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:03.517368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6d9e1a0-9e64-409f-a262-d54484250443 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28642 microversion: 2.1 time: 0.104731 Nov 23 10:23:03.524875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 427/828] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:03 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:04.091961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:04.093481 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:04.113531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:04.114943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:04.116850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:04.119019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:04.260399 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:04.274443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:04.277833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:04.280272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c569d4d-cdb5-4c2d-a25a-d6c076e295fe tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1332 microversion: 2.20 time: 0.200879 Nov 23 10:23:04.281641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 402/829] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:04 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1332 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:04.537513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:04.539225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:04.550313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:04.552079 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:04.554546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:04.556166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:04.674944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8a63699e-e3f9-4daa-9d49-913fe0d1263e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 28642 microversion: 2.1 time: 0.142378 Nov 23 10:23:04.677886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 428/830] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:04 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 28642 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:05.432004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:05.432641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:05.440310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:05.441361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:05.442998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:05.443963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:05.576223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:05.586200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:05.591589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:05.595578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-adb65b6c-3703-4259-a336-09eeade91c36 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1338 microversion: 2.20 time: 0.288004 Nov 23 10:23:05.600543 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 403/831] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:05 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:05.693748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:05.696337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:05.709103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:05.709950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:05.711359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:05.712446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:05.814093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40ca0d05-4174-4708-bfa5-81d83f1ab1ea tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 29644 microversion: 2.1 time: 0.127119 Nov 23 10:23:05.815961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 429/832] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:05 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 29644 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:06.619890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:06.620492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:06.636371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:06.637094 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:06.638142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:06.638733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:06.831698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:06.833562 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:06.850768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:06.852217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:06.853384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:06.854075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:06.943616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e5f8723-765e-43fd-a195-0dc993ba133a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 31608 microversion: 2.1 time: 0.116650 Nov 23 10:23:06.945338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 430/833] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:06 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 31608 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:23:07.166734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:07.180215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:07.182743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:07.184062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1c7b2d6-dcc1-4bfb-bb8b-146c5658cc0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.568223 Nov 23 10:23:07.184874 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 404/834] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:06 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:07.544469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-54a638ea-98f0-4271-a329-d8f9cb99e1af req-c03f62ad-1292-48d9-b8fd-411ede970be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:07.546263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:07.546263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:23:07.559695 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-54a638ea-98f0-4271-a329-d8f9cb99e1af req-c03f62ad-1292-48d9-b8fd-411ede970be6 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:07.561223 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-54a638ea-98f0-4271-a329-d8f9cb99e1af req-c03f62ad-1292-48d9-b8fd-411ede970be6 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:07.574890 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-54a638ea-98f0-4271-a329-d8f9cb99e1af req-c03f62ad-1292-48d9-b8fd-411ede970be6 service nova] Creating event network-changed:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:23:07.581318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-54a638ea-98f0-4271-a329-d8f9cb99e1af req-c03f62ad-1292-48d9-b8fd-411ede970be6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195592 Nov 23 10:23:07.583131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 431/835] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:07.974535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:07.976502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:07.998947 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:07.999920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:08.004231 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:08.006903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:08.118310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-51adac45-1122-42a9-8416-b5872dba6ce1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 33065 microversion: 2.1 time: 0.156314 Nov 23 10:23:08.119503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 405/836] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:07 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 33065 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:08.208636 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:08.209511 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:08.223760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:08.228629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:08.232494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:08.233082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:08.503845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:08.512982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:08.514520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:08.516004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4060297e-d79f-4bd0-baa0-e9ffe5545a3f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.315383 Nov 23 10:23:08.517400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 432/837] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:08 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:09.134064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:09.136844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:09.150047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:09.150047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:09.150047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:09.150047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:09.271089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e33fb4bc-b672-4199-816f-7bd3db5dae20 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 33796 microversion: 2.1 time: 0.143661 Nov 23 10:23:09.273178 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 406/838] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:09 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 33796 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:09.535173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:09.536028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:09.544810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:09.545239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:09.548946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:09.548946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:09.750037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:09.759779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:09.761319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:09.762971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-937ce545-c4b2-441e-b0c1-7b2239223864 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.232265 Nov 23 10:23:09.763657 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 433/839] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:09 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:10.205579 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'create', calling method: .version_select at 0x7f9fd7d9aa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1583072571"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:10.231462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for project a9f502da36fe4189bebca087c4fca337. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:23:10.238300 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for user 6b2b8807bd524d81ac3d0ae16853f515 and project a9f502da36fe4189bebca087c4fca337. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:23:10.295376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:10.296693 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:10.304441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:10.305671 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:10.306898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:10.307499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:10.409150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dfce7cf1-08c9-4be8-bbd8-8bf985d5c2d2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 34929 microversion: 2.1 time: 0.121545 Nov 23 10:23:10.409851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 434/840] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:10 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 34929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:10.594338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for project a9f502da36fe4189bebca087c4fca337. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:23:10.599948 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for user 6b2b8807bd524d81ac3d0ae16853f515 and project a9f502da36fe4189bebca087c4fca337. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:23:10.616237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96746afa-e586-4489-9c38-3320a658d577 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.416986 Nov 23 10:23:10.616943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 407/841] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 23 10:23:10 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:10.741426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1307050054", "imageRef": "748d3a0b-47c7-4191-9d46-9c6e99d3ecd7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1583072571", "networks": [{"uuid": "0a82edb2-2540-44c2-a980-9e68c4ad5db5"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:10.781366 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:10.782486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:10.791097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:10.791743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:10.792531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:10.792962 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:10.800749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] validate_networks() for [('0a82edb2-2540-44c2-a980-9e68c4ad5db5', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:23:10.937516 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:10.946617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:10.948410 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:10.949600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4f408770-2eb6-42f8-ab37-98e6722b7a28 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.172086 Nov 23 10:23:10.950163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 408/842] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:10 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:11.264580 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:23:11.265010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:23:11.265554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:23:11.265993 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:23:11.266415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:23:11.277098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.277667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:11.278608 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.279109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:11.297768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for project a9f502da36fe4189bebca087c4fca337. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:23:11.301839 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Getting quotas for user 6b2b8807bd524d81ac3d0ae16853f515 and project a9f502da36fe4189bebca087c4fca337. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:23:11.312960 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:23:11.315438 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='748d3a0b-47c7-4191-9d46-9c6e99d3ecd7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:23:11.363590 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-403324c8-b992-4d45-9cce-544ec07d8500 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626132 Nov 23 10:23:11.368927 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 435/843] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:23:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:23:11.375781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e38b2b3d-1265-4ec4-b40f-a65b76bfb94f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:11.376405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e38b2b3d-1265-4ec4-b40f-a65b76bfb94f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:11.423329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:11.425023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:11.432490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.433045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:11.434001 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.434561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:11.453686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e38b2b3d-1265-4ec4-b40f-a65b76bfb94f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:11.463606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e38b2b3d-1265-4ec4-b40f-a65b76bfb94f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1259 microversion: 2.1 time: 0.090739 Nov 23 10:23:11.464200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 409/844] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:11 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1259 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:11.529017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8f31c141-7f12-464f-9f30-215c60df2fae tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 36273 microversion: 2.1 time: 0.110056 Nov 23 10:23:11.531730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 436/845] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:11 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 36273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:23:11.968701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:11.969319 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:11.986901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.987667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:11.988737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:11.989315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:12.168168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:12.177322 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:12.179162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:12.180491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-771784de-d811-441b-b86e-590e5ffb938d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.216476 Nov 23 10:23:12.181601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 410/846] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:11 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:12.483244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:12.484187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:12.492035 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:12.492476 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:12.493264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:12.493764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:12.543573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:12.544597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:12.551995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:12.552760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:12.554107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:12.554942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:12.581007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:12.594018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-191eaac6-b4f9-4d50-8549-ab5ecf49b3ad tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1319 microversion: 2.1 time: 0.116480 Nov 23 10:23:12.598078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 437/847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:12 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:12.662176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b81b4314-2e57-42ec-a1d3-d87fe2906446 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 37700 microversion: 2.1 time: 0.122051 Nov 23 10:23:12.663185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 411/848] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:12 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 37700 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:23:13.201922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:13.202665 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:13.211340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.211802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.212614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.213392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.488968 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:13.531050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:13.544874 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:13.548634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-206fb0be-1849-4507-b47e-c60e7cf95be5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.351824 Nov 23 10:23:13.554206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 438/849] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:13 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:13.616435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:13.617440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:13.643331 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.644157 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.645796 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.646850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.697860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:13.697860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:13.697860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.697860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.698652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:13.698652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:13.876245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd5ddce6-ae72-4362-98c4-738ed9f088ca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 38177 microversion: 2.1 time: 0.203049 Nov 23 10:23:13.886406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 439/850] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:13 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 38177 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:14.200695 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:14.217164 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20ed73c1-a012-4796-a5f2-45c097fe603a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.607357 Nov 23 10:23:14.223784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 412/851] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:13 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:14.454775 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ad1f1be1-aab0-469d-b0ae-d76ac4365f74 req-f597d41e-a483-4a76-a388-33b305b408d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "name": "network-vif-plugged", "status": "completed", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:14.463663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:14.463663 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:23:14.480615 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ad1f1be1-aab0-469d-b0ae-d76ac4365f74 req-f597d41e-a483-4a76-a388-33b305b408d0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:14.483732 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ad1f1be1-aab0-469d-b0ae-d76ac4365f74 req-f597d41e-a483-4a76-a388-33b305b408d0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:14.529933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ad1f1be1-aab0-469d-b0ae-d76ac4365f74 req-f597d41e-a483-4a76-a388-33b305b408d0 service nova] Creating event network-vif-plugged:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:23:14.537956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ad1f1be1-aab0-469d-b0ae-d76ac4365f74 req-f597d41e-a483-4a76-a388-33b305b408d0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089894 Nov 23 10:23:14.543487 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 440/852] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:14.572271 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:14.573262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:14.581306 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:14.582144 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:14.583258 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:14.583912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:14.893602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:14.895507 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:14.903621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:14.904453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:14.905718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:14.906685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:15.326492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:15.367569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:15.374733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:15.377803 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ed18b9b-0426-45d1-a745-405246381f96 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.808969 Nov 23 10:23:15.379528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 413/853] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:14 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:15.403990 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:15.406202 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:15.415855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:15.416840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:15.418207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:15.419024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:15.768950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:15.783084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dbc0b0cc-10b7-429e-921d-551493812dab tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.385431 Nov 23 10:23:15.784286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 414/854] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:15 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:15.796231 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-1cc373bb-e01a-4c9d-b360-85dfc3583257 req-15d1c0f8-56d0-4776-a016-ab8f8d97173f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:15.799504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:15.799504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:23:15.813014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-1cc373bb-e01a-4c9d-b360-85dfc3583257 req-15d1c0f8-56d0-4776-a016-ab8f8d97173f service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:15.816031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-1cc373bb-e01a-4c9d-b360-85dfc3583257 req-15d1c0f8-56d0-4776-a016-ab8f8d97173f service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:15.831576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-1cc373bb-e01a-4c9d-b360-85dfc3583257 req-15d1c0f8-56d0-4776-a016-ab8f8d97173f service nova] Creating event network-changed:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:23:15.837460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-1cc373bb-e01a-4c9d-b360-85dfc3583257 req-15d1c0f8-56d0-4776-a016-ab8f8d97173f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051269 Nov 23 10:23:15.838719 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 415/855] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:16.407460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:16.408909 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:16.432837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:16.446004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:16.447958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:16.449112 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:16.717912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:16.742203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:16.747097 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:16.749850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2dec8e95-4794-4f44-b3e3-9b89f6605459 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.346292 Nov 23 10:23:16.751494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 416/856] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:16 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:16.816141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:16.817663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:16.828110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:16.828880 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:16.830825 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:16.831607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:17.036222 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:17.049344 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-583cf601-6ca6-4e8d-ba62-6ee0557dba83 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.240217 Nov 23 10:23:17.050599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 417/857] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:16 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:17.769208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:17.770514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:17.777103 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:17.777923 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:17.778381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:17.782141 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:18.007847 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:18.020107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:18.021927 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:18.023303 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ab1b551-1496-4b64-9b63-2520c576d635 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.257834 Nov 23 10:23:18.024041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 418/858] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:17 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:18.074406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:18.075018 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:18.086517 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:18.087250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:18.088252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:18.089123 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:18.323891 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:18.332314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c6593bdb-d1e8-4999-927b-b55926a4fabf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.262850 Nov 23 10:23:18.341685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 419/859] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:18 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:19.043959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:19.045070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:19.051657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:19.052526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:19.066971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:19.066971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:19.264193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:19.277409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:19.283139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:19.289377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-56433a48-b490-4744-97b4-b708f5a6cdde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.248092 Nov 23 10:23:19.291942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 420/860] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:19 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:19.354240 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:19.355564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:19.367241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:19.368120 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:19.369583 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:19.370496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:19.578942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:19.592543 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cb1e843a-3a9a-47c2-be60-153823f037f4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.244976 Nov 23 10:23:19.594017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 421/861] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:19 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:20.324349 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:20.329275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:20.339321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:20.339879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:20.340717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:20.341156 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:20.599345 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:20.612328 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:20.616201 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:20.618545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34a5de2c-cfec-4b84-9597-a0ad14efc679 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.301652 Nov 23 10:23:20.620218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 422/862] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:20 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:20.640355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:20.641283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:20.651438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:20.652252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:20.653772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:20.654617 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:20.867920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:20.878085 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b071c184-645a-453a-b402-15f520c6e7f7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.255880 Nov 23 10:23:20.879206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 423/863] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:20 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:21.651266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:21.653437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:21.664278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:21.664772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:21.667062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:21.667511 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:21.892148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:21.906346 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:21.909184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:21.911556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5396ded6-c649-4039-8051-56392a390c02 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.268538 Nov 23 10:23:21.912569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 424/864] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:21 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:21.920395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:21.921506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:21.932247 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:21.933057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:21.937721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:21.937721 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:22.177544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:22.186030 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dd341a2f-4486-43a7-b6a1-1bf264cd38a3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.272023 Nov 23 10:23:22.186726 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 425/865] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:21 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:22.940958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:22.941910 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:22.948784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:22.949269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:22.950132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:22.950607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:23.124876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:23.134015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:23.135521 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:23.136643 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-27714f24-b581-4619-a447-204beb193c2b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.202455 Nov 23 10:23:23.137211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 426/866] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:22 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:23.208421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:23.209106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:23.215531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:23.215959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:23.216751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:23.217189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:23.361908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:23.369842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b6de6148-f41d-4e24-ab71-e5052a5210f2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.166127 Nov 23 10:23:23.370414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 427/867] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:23 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:24.154906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:24.155744 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:24.163403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.163779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.164697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.165125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.303943 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-470c98db-dab8-4b60-8610-dae7d2e44622 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 200 len: 38308 microversion: 2.1 time: 9.416121 Nov 23 10:23:24.305642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 441/868] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:14 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 38308 bytes in 9419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:23:24.324730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:24.326027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:24.335289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.336392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.337564 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.338427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.357166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:24.376362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:24.379761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:24.382236 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4d61362-3203-4c79-bc87-e60835361695 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.230725 Nov 23 10:23:24.385449 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 428/869] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:24 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:24.392967 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e8a4d30-21ab-4392-9ab4-6b7a448b9b7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/ips" status: 200 len: 146 microversion: 2.1 time: 0.076544 Nov 23 10:23:24.393924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 442/870] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:23:24 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/ips => generated 146 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:24.401923 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:24.403225 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:24.410965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.411427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.412421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:24.413371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:24.791205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:24.809064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-829d882c-4739-40b0-8702-a1c3789a470e tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.408803 Nov 23 10:23:24.813084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 429/871] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:24 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:25.404055 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:25.404606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:25.414434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:25.414878 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:25.415669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:25.416105 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:25.557579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:25.566107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:25.567641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:25.569367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50ac9a2a-7e84-44ce-9c5b-90091494cd8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.169049 Nov 23 10:23:25.569965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 443/872] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:25 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:25.836262 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:25.837659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:25.849577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:25.850388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:25.851791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:25.852531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:26.019234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:26.026652 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3888aa15-26e6-4b2e-a89f-fc20965dfc67 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.197306 Nov 23 10:23:26.027220 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 430/873] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:25 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:26.590969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:26.591650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:26.598501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:26.598953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:26.599928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:26.600368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:26.737705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:26.745715 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:26.747239 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:26.748319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1836b208-2e32-4938-ae32-f482c32739d7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.161451 Nov 23 10:23:26.748896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 444/874] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:26 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:27.046665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:27.046665 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:27.053624 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:27.054109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:27.054889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:27.055324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:27.209436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:27.216802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a491eb5b-23e4-4024-b941-2183fea51bd4 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.174952 Nov 23 10:23:27.217389 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 431/875] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:27 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:27.768075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:27.768672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:27.774975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:27.775422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:27.776195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:27.776630 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:27.925842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:27.933448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:27.934985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:27.936079 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-76502aaa-1c60-4cfe-9e29-fe353df7ed90 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.172361 Nov 23 10:23:27.936632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 445/876] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:27 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:28.235268 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:28.237413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:28.250860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:28.251692 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:28.253130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:28.253808 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:28.453813 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:28.464209 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-506ed724-71d0-4659-902f-b9e03512704f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.233043 Nov 23 10:23:28.465075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 432/877] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:28 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:28.956645 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:28.957337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:28.963634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:28.964049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:28.964828 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:28.965251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:29.177116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:29.185454 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:29.187357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:29.188459 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8b7b3081-97da-4ff4-b77e-d741e1b9201f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1406 microversion: 2.20 time: 0.236857 Nov 23 10:23:29.189231 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 446/878] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:28 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:29.486094 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:29.487202 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:29.494155 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:29.494609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:29.495395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:29.495833 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:29.640912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:29.650642 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d677aed9-92a6-4046-a633-19208a9c46d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.172010 Nov 23 10:23:29.651250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 433/879] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:29 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:29.686172 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8469e35b-f5e4-4351-b62f-925c7e3da7be"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:29.687316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:29.693194 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:29.693625 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:29.694438 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:29.694870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.207770 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:30.208632 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:30.215707 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.216309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.217645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.218252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.367387 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:30.377588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:30.379184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:30.380482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bec13456-de9a-49fc-a214-2d6f17945a74 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1597 microversion: 2.20 time: 0.177714 Nov 23 10:23:30.381052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 434/880] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:23:30 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1597 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:23:30.406505 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:30.406872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:30.413186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.413672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.414483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.414921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.505118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd787732-5411-4349-a6ec-fba9f49c1642 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102282 Nov 23 10:23:30.505759 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 435/881] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Nov 23 10:23:30 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:23:30.675325 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:30.675838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:30.681778 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.682224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.682994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:30.683430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:30.946047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:30.954952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5637ecf2-06f5-4643-b409-84d7e799ee19 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.283401 Nov 23 10:23:30.955540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 436/882] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:30 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:31.906654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:31.907609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:31.919455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:31.919913 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:31.920720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:31.921163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:32.254540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-037d1732-78e9-49ed-a383-b119d9cbe68e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.351625 Nov 23 10:23:32.255330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 437/883] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:31 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:32.261203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-8aba1251-8ff8-4be3-a63a-03def8f17e3b req-4bfc2bdb-7be1-4c1e-b2a0-45b2b4a225e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:32.263368 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:32.263368 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:23:32.271675 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8aba1251-8ff8-4be3-a63a-03def8f17e3b req-4bfc2bdb-7be1-4c1e-b2a0-45b2b4a225e7 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:32.272129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8aba1251-8ff8-4be3-a63a-03def8f17e3b req-4bfc2bdb-7be1-4c1e-b2a0-45b2b4a225e7 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:32.295977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-8aba1251-8ff8-4be3-a63a-03def8f17e3b req-4bfc2bdb-7be1-4c1e-b2a0-45b2b4a225e7 service nova] Creating event network-changed:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:23:32.305537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-8aba1251-8ff8-4be3-a63a-03def8f17e3b req-4bfc2bdb-7be1-4c1e-b2a0-45b2b4a225e7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048718 Nov 23 10:23:32.307493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 438/884] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:32.321586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:32.324724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:32.338453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:32.339415 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:32.341220 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:32.342175 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:32.418692 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bade6e6f-cfbf-45ab-8dfb-5e15da3bfc78 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.736328 Nov 23 10:23:32.419962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 447/885] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:23:29 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments => generated 194 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:32.700840 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:32.711358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-432f35c0-a2e0-40dd-bf3e-906e94623e5f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.398010 Nov 23 10:23:32.712134 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 439/886] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:32 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:33.267706 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:33.275694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:33.280575 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:33.281107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:33.282187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:33.282817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:33.365371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6fdfa3f-3eab-4354-bab5-35aba8d3e4fa tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.102674 Nov 23 10:23:33.366515 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 448/887] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:33 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:33.729102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:33.729938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:33.737560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:33.738246 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:33.739342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:33.740113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:33.902288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:33.911227 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8bde25d6-c309-449b-a8e9-e81c5d1a5e44 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.186009 Nov 23 10:23:33.913104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 440/888] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:33 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:34.378769 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:34.379185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:34.387934 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:34.388391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:34.389201 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:34.389817 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:34.427190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c22ca542-e392-4b34-9700-e506bf669bed req-072b4958-1409-48fa-aa23-df5f73a3f6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "name": "network-vif-plugged", "status": "completed", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:34.428707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:34.428707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:23:34.436701 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c22ca542-e392-4b34-9700-e506bf669bed req-072b4958-1409-48fa-aa23-df5f73a3f6a2 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:34.437139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c22ca542-e392-4b34-9700-e506bf669bed req-072b4958-1409-48fa-aa23-df5f73a3f6a2 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:34.448123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c22ca542-e392-4b34-9700-e506bf669bed req-072b4958-1409-48fa-aa23-df5f73a3f6a2 service nova] Creating event network-vif-plugged:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:23:34.453463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c22ca542-e392-4b34-9700-e506bf669bed req-072b4958-1409-48fa-aa23-df5f73a3f6a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178416 Nov 23 10:23:34.454132 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 449/889] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:23:34.467475 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7505ed1-350c-4204-9caa-37aa9e29b113 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.094566 Nov 23 10:23:34.469902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 441/890] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:34 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:34.930997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:34.931618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:34.938050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:34.938527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:34.939845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:34.940273 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:35.074830 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:35.082025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b82010b-5898-4ef1-bdb3-e7de7cba3a52 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1359 microversion: 2.1 time: 0.155599 Nov 23 10:23:35.082600 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 450/891] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:34 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:35.481020 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:35.482021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:35.489517 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:35.490070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:35.490945 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:35.494908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:35.570460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-165da069-0d81-4f0b-8de8-efc9446f25ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.093419 Nov 23 10:23:35.571107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 442/892] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:35 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:36.100071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:36.100687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:36.107163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.107604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.108380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.108857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.248896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:36.257899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9be77308-6713-4438-8de8-c54284b98cc9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1550 microversion: 2.1 time: 0.162127 Nov 23 10:23:36.258466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 451/893] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:36 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:36.274142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:36.274839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:36.282839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.283288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.284079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.284576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.449762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:36.458825 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-74348d45-a965-46b5-89d0-a131004142d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1550 microversion: 2.1 time: 0.188590 Nov 23 10:23:36.459470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 443/894] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:36 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1550 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:36.474961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:36.478549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:36.478549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:23:36.479528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:36.480364 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Searching by: {'deleted': False, 'project_id': 'a9f502da36fe4189bebca087c4fca337'} {{(pid=116103) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 23 10:23:36.488152 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.488589 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.489388 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.489843 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.583279 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:36.584296 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:36.590097 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.multi_cell_list [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 23 10:23:36.591629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.592085 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.592882 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.593325 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.657867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9cc7e787-a5f7-49d1-a175-4d56e855ae0a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.078112 Nov 23 10:23:36.669734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 444/895] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:36 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:36.698857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbed3e65-135a-4f68-9304-dd7d53b5dfcf tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227258 Nov 23 10:23:36.699367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 452/896] 10.222.0.41 () {58 vars in 1124 bytes} [Tue Nov 23 10:23:36 2021] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:36.710317 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:36.711082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:36.718360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.718806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.719595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:36.720524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:36.868208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:36.876223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f94657d-81a1-4048-9d62-9aa8af57f6d1 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1550 microversion: 2.1 time: 0.170137 Nov 23 10:23:36.876784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 445/897] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:36 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:37.681856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:37.683333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:37.690479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:37.691041 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:37.691833 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:37.692311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:37.757059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-763c2cd9-e01f-462f-b564-8405a96bd9a5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.080260 Nov 23 10:23:37.757722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 453/898] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:37 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:38.393540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77c2a8d9-ab62-42f9-ad6b-e3063e8a491b"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:38.394795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:38.402848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:38.403651 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:38.404999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:38.405791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:38.708406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5579ed1c-1e8a-4931-a763-194fbc5549f5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319097 Nov 23 10:23:38.709005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 446/899] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:23:38 2021] POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:23:38.768872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:38.770119 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:38.787858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:38.788678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:38.790237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:38.790722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:38.884585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e05f325-2fed-4902-8451-886600a235ad tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.119616 Nov 23 10:23:38.885394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 454/900] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:38 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:39.896589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:39.897635 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:39.903902 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:39.904341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:39.905148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:39.905580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:39.980421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c25a2407-3b90-4cc4-953e-bea5483cf875 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.088117 Nov 23 10:23:39.981589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 447/901] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:39 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:40.020265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6ea43e4-f3d6-4839-ba10-cfb13c3772e8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:40.030246 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ea43e4-f3d6-4839-ba10-cfb13c3772e8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:40.030707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ea43e4-f3d6-4839-ba10-cfb13c3772e8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:40.095703 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6ea43e4-f3d6-4839-ba10-cfb13c3772e8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Going to try to stop instance {{(pid=116103) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 10:23:40.151669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6ea43e4-f3d6-4839-ba10-cfb13c3772e8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 202 len: 0 microversion: 2.1 time: 0.134942 Nov 23 10:23:40.152623 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 455/902] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:40 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:40.164417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:40.165121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:40.173398 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:40.173932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:40.174780 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:40.175224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:40.323284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:40.331352 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-622d1412-4e22-4cb8-8400-a3eb8f1890f1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.173296 Nov 23 10:23:40.331940 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 448/903] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:40 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:40.993252 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:40.994287 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:41.000946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:41.001396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:41.002222 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:41.002662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:41.075030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fae56803-e3fd-477b-a1cc-d1866083df49 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 14 microversion: 2.20 time: 0.085687 Nov 23 10:23:41.075698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 456/904] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:40 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:41.350335 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:41.351361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:41.360217 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:41.360714 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:41.361518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:41.361992 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:41.531596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:41.540848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2970ad5-4341-465b-92d2-0b848742db0d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.194880 Nov 23 10:23:41.541436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 449/905] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:41 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:42.086801 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:42.087799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:42.097028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:42.097643 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:42.098470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:42.098910 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:42.181315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a1ac130-128a-408a-8096-a7dc67b15f88 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 3791 microversion: 2.20 time: 0.098321 Nov 23 10:23:42.181907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 457/906] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:42 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 3791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:23:42.559223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:42.559963 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:42.567604 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:42.568048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:42.568846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:42.569423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:42.713052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:42.722595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e3274c4c-35c2-4c2a-b7bd-ba16ddfe7774 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.167044 Nov 23 10:23:42.723265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 450/907] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:42 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:43.193466 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:43.194467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:43.201618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:43.202160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:43.202972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:43.203398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:43.296510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-511f20a3-b85f-4a5d-9f3f-c39d51e0356e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 13312 microversion: 2.20 time: 0.106957 Nov 23 10:23:43.297170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 458/908] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:43 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 13312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:43.742785 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:43.743672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:43.751286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:43.751286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:43.752147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:43.752808 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:43.917957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:43.928960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-90e80838-fa9e-4a73-b036-358fa218b751 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.191288 Nov 23 10:23:43.929876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 451/909] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:43 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:44.309934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:44.311175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:44.323423 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:44.324310 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:44.325591 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:44.326402 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:44.429620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a27d1349-ade5-4db9-b295-a2eb2fb8e022 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 18398 microversion: 2.20 time: 0.123752 Nov 23 10:23:44.430348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 459/910] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:44 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 18398 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:44.947342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:44.947959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:44.957589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:44.958419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:44.959980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:44.960792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:45.189183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:45.204087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-635ebe8f-5c15-4401-bff5-4f0a5e6ffd1f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.260405 Nov 23 10:23:45.204870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 452/911] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:44 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:45.446841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:45.447872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:45.457173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:45.457836 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:45.458978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:45.459666 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:45.556588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1f92ebad-4d95-4463-8736-8596338feb1c tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 19342 microversion: 2.20 time: 0.114468 Nov 23 10:23:45.557922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 460/912] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:45 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 19342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:46.228838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:46.229472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:46.236819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.237267 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.238222 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.238807 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.418306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:46.419584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:46.431015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:46.433923 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.434609 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.435836 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.436622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.445762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-72a0c308-d864-4875-b8d3-dcb3d7dcb6d0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.220760 Nov 23 10:23:46.446654 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 453/913] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:46 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:23:46.574135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:46.576044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:46.587045 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.587800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.589245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:46.590113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:46.649100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:46.661150 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ca98b941-13de-4a89-a079-dc897151c482 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1596 microversion: 2.1 time: 0.250817 Nov 23 10:23:46.663095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 461/914] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:46 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1596 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:46.691203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e87a69d5-a923-497d-9e09-41d21bed274b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 22015 microversion: 2.20 time: 0.123132 Nov 23 10:23:46.692535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 454/915] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:46 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 22015 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:47.470445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:47.471538 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:47.481499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:47.482272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:47.484322 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:47.485303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:47.649445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:47.668808 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bd4ca08-5105-4c92-b48f-d74e12e27790 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.203750 Nov 23 10:23:47.669452 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 462/916] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:47 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:47.709383 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:47.711393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:47.722513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:47.723163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:47.724452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:47.724959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:47.810925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4390304d-18c3-47e4-af4b-310166ec8a04 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 23229 microversion: 2.20 time: 0.108704 Nov 23 10:23:47.811596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 455/917] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:47 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 23229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:48.695174 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:48.695908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:48.702410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:48.702860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:48.703754 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:48.704668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:48.826560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:48.828294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:48.841237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:48.842405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:48.843422 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:48.844206 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:48.901506 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:48.911750 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa3f764d-1447-4f98-bbfd-af01f253e9e4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.223628 Nov 23 10:23:48.912360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 463/918] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:48 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:48.938502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9b2fc8d2-ca91-4807-bcb3-8b6f9522c941 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 24574 microversion: 2.20 time: 0.118068 Nov 23 10:23:48.940014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 456/919] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:48 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 24574 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:48.987478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ce8c85b4-93b6-46a1-a47e-fecb3d5b8975 req-c56fdfb6-696f-4a28-865f-52fc66ef477a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:48.989002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:48.989002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:23:48.996279 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ce8c85b4-93b6-46a1-a47e-fecb3d5b8975 req-c56fdfb6-696f-4a28-865f-52fc66ef477a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:48.996718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ce8c85b4-93b6-46a1-a47e-fecb3d5b8975 req-c56fdfb6-696f-4a28-865f-52fc66ef477a service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:49.010342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ce8c85b4-93b6-46a1-a47e-fecb3d5b8975 req-c56fdfb6-696f-4a28-865f-52fc66ef477a service nova] Creating event network-changed:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:23:49.016664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ce8c85b4-93b6-46a1-a47e-fecb3d5b8975 req-c56fdfb6-696f-4a28-865f-52fc66ef477a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032680 Nov 23 10:23:49.017731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 464/920] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:23:49.934552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:49.935313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:49.955687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:49.958825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:49.960479 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:49.960941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:49.962365 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:49.963003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:49.980105 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:49.980828 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:49.983259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:49.984456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:50.088170 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3101c207-ad7c-4fa7-8761-90c7d63a7ec1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 25830 microversion: 2.20 time: 0.138036 Nov 23 10:23:50.088385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 465/921] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:49 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 25830 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:50.246795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-178807116"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:50.247425 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:50.255059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:50.255677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:50.256492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:50.257182 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:50.285598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:50.296130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-723e7fe3-6b88-4561-8a18-7c6c2853f423 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.365524 Nov 23 10:23:50.307471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 457/922] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:49 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:50.458502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.network.security_group_api [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Adding security group e464a0a4-a85c-4be7-9f16-69b54b3aa67a to port 95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 Nov 23 10:23:50.953550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad651218-a3eb-4f92-bc25-747fb6fc83d6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action" status: 202 len: 0 microversion: 2.1 time: 0.711118 Nov 23 10:23:50.964605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 466/923] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:23:50 2021] POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:50.976705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:50.977668 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:51.003572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.004214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.006673 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.008793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.179888 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-524d6053-d52e-4d86-846d-84e2600bee7c req-ffc461b7-6275-4966-bf25-4649e6d9de34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:51.182419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:23:51.182419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:23:51.198784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-524d6053-d52e-4d86-846d-84e2600bee7c req-ffc461b7-6275-4966-bf25-4649e6d9de34 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.199745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-524d6053-d52e-4d86-846d-84e2600bee7c req-ffc461b7-6275-4966-bf25-4649e6d9de34 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.213147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-524d6053-d52e-4d86-846d-84e2600bee7c req-ffc461b7-6275-4966-bf25-4649e6d9de34 service nova] Creating event network-changed:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:23:51.222423 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-524d6053-d52e-4d86-846d-84e2600bee7c req-ffc461b7-6275-4966-bf25-4649e6d9de34 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264907 Nov 23 10:23:51.223599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 458/924] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:23:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:23:51.229265 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:51.230378 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:51.238435 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.238981 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.239732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.240181 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.273419 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:51.284437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe534f58-ca9d-4626-b289-1e3e77e5e49d tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1761 microversion: 2.1 time: 0.317225 Nov 23 10:23:51.285640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 467/925] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:50 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1761 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:51.319454 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:51.320262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:51.328867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.331263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b349581d-40e1-4c4d-8c3b-4e8f80233794 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 26782 microversion: 2.20 time: 0.105053 Nov 23 10:23:51.332767 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.332972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 459/926] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:51 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 26782 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:51.333228 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:51.333440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:51.539329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:51.569654 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-209728d7-d59f-4537-aad1-5ca86e930fca tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.256413 Nov 23 10:23:51.573443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 468/927] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:51 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:52.345342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:52.346388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:52.353786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:52.354241 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:52.355040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:52.355477 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:52.454669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47a9eddd-0a86-463d-af8f-516405a49218 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 27413 microversion: 2.20 time: 0.113874 Nov 23 10:23:52.455336 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 460/928] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:52 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 27413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:52.599324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:52.599936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:52.606731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:52.607187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:52.607965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:52.608394 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:52.751371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:52.759676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bb62121-9b02-45a4-ba94-ecd34d65c7b1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.164986 Nov 23 10:23:52.760251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 469/929] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:52 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:53.470314 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:53.471553 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:53.479261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:53.479707 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:53.480505 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:53.480942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:53.563839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ab00d64-cdb6-4e2f-be80-5557729180e2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 27764 microversion: 2.20 time: 0.099912 Nov 23 10:23:53.564586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 461/930] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:53 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 27764 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:53.778796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:53.779559 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:53.787889 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:53.788403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:53.789213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:53.789655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:53.928617 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:53.937323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e6ae463-80ef-4a0b-97c1-226cf5c7dd26 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.162888 Nov 23 10:23:53.938539 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 470/931] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:53 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:54.576591 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:54.577493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:54.586404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:54.586853 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:54.587707 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:54.588133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:54.685450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2dc13bc2-2e87-49d9-bed4-ff54112d0709 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28246 microversion: 2.20 time: 0.113130 Nov 23 10:23:54.686151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 462/932] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:54 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:23:54.957610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:54.958446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:54.964719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:54.965159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:54.965959 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:54.966393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:55.110195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:55.118189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98030123-b6dd-4d91-adb2-735f03149d59 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.164839 Nov 23 10:23:55.118780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 471/933] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:54 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:55.699625 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:55.700719 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:55.708036 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:55.708485 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:55.709269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:55.709737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:55.776859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d64ac33d-b036-4ee5-bfec-ec1e18ae9225 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28246 microversion: 2.20 time: 0.081264 Nov 23 10:23:55.777576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 463/934] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:55 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:56.136304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:56.137022 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:56.144281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:56.144818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:56.145740 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:56.146288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:56.602269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:56.611206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4acfb004-7505-49de-9727-a01853568742 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.478641 Nov 23 10:23:56.611795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 472/935] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:56 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:56.792819 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:56.793806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:56.801119 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:56.801577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:56.802484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:56.802921 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:56.878164 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d7440ac-8526-4739-a9eb-16871fb52996 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28246 microversion: 2.20 time: 0.091823 Nov 23 10:23:56.878830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 464/936] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:56 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:57.637736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:57.638360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:57.644585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:57.645028 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:57.645834 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:57.646261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:57.798267 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:57.812980 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e8aa638-8186-46af-ad57-523f129fa054 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.179032 Nov 23 10:23:57.813563 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 473/937] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:57 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:57.892953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:57.893890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:57.900769 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:57.901211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:57.902153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:57.902592 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:58.005908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-57a41871-a02d-4c6d-a624-7a6923099396 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28537 microversion: 2.20 time: 0.117338 Nov 23 10:23:58.007011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 465/938] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:57 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:23:58.829384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:23:58.830031 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:58.836368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:58.836810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:58.837579 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:58.838036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:58.992698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:23:58.998975 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c65d1d9-facd-4bb1-92c1-27d14fddffd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.173460 Nov 23 10:23:58.999578 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 474/939] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:23:58 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:23:59.020196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:23:59.021468 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:23:59.029283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:59.029774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:59.030571 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:23:59.031005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:23:59.132539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5d4130e-c13e-4600-80b0-7eb5a63d770f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28696 microversion: 2.20 time: 0.116601 Nov 23 10:23:59.133482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 466/940] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:23:59 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28696 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:00.016794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:00.017370 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:00.024875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:00.025329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:00.026211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:00.026648 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:00.147539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:00.148598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:00.155711 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:00.156158 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:00.157011 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:00.157443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:00.201406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:00.209686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80aceebe-bd13-488c-9da5-c2c5136d6535 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.197148 Nov 23 10:24:00.210299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 475/941] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:00 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:00.244064 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df25ce8e-1c1b-4800-ab00-346001323730 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28705 microversion: 2.20 time: 0.101972 Nov 23 10:24:00.245219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 467/942] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:00 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28705 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:01.232858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:01.233664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:01.240036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:01.240505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:01.241292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:01.241781 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:01.259594 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:01.261313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:01.272211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:01.272974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:01.274245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:01.274987 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:01.363339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7fbc5572-9619-4356-9faa-ee2fc54ef789 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28705 microversion: 2.20 time: 0.109161 Nov 23 10:24:01.364035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 468/943] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:01 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28705 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:01.406108 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:01.415198 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50396158-979b-4d99-938d-88efc33b3c45 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.186140 Nov 23 10:24:01.415778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 476/944] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:01 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:02.377417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:02.378777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:02.386747 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:02.387196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:02.387999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:02.388451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:02.432597 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:02.433420 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:02.440091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:02.440549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:02.441375 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:02.441842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:02.469965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4bf76cc-7eed-4945-ad2d-188d7fffe0e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28705 microversion: 2.20 time: 0.096999 Nov 23 10:24:02.471735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 469/945] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:02 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28705 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:02.599024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:02.611288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50e1515e-0e90-4f47-9118-ec55e5b08dad tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.182253 Nov 23 10:24:02.611882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 477/946] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:02 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:03.486618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:03.487623 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:03.496065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:03.496515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:03.497357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:03.497850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:03.575340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d398ec31-c3a5-48e7-9102-c04f1bcd87b5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 28705 microversion: 2.20 time: 0.094546 Nov 23 10:24:03.576439 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 470/947] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:03 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 28705 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:03.628700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:03.629320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:03.636043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:03.636647 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:03.637344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:03.638107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:03.816071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:03.825778 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba808646-ef29-4bf8-bbe9-c065a8d35662 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.200873 Nov 23 10:24:03.826538 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 478/948] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:03 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:04.587978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:04.588877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:04.596445 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:04.596885 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:04.597661 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:04.598111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:04.687320 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41449ceb-6a74-4472-8a60-83f3f818e3ed tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 29154 microversion: 2.20 time: 0.103322 Nov 23 10:24:04.688553 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 471/949] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:04 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 29154 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:04.850024 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:04.850660 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:04.859672 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:04.860471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:04.861905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:04.862678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:05.028254 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:05.040261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a6599302-df90-4e76-bef2-a40d57500c83 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1722 microversion: 2.1 time: 0.194436 Nov 23 10:24:05.040883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 479/950] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:04 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:05.700871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:05.701781 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:05.709392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:05.709868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:05.710649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:05.711081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:05.795076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-870e30c0-d5d0-4c36-8455-cb961d157dda tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 30746 microversion: 2.20 time: 0.098208 Nov 23 10:24:05.796070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 472/951] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:05 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 30746 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:06.058089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:06.058942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:06.066093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.066661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.067403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.067898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.207410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:06.221017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aad3d680-e781-45bf-8bd5-024c8dcbb682 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1699 microversion: 2.1 time: 0.166447 Nov 23 10:24:06.221616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 480/952] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:06 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:06.238154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1c4aaea-d2cc-4e41-85ea-f6f8d658204f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:06.245022 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c4aaea-d2cc-4e41-85ea-f6f8d658204f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.245510 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c4aaea-d2cc-4e41-85ea-f6f8d658204f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.310173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1c4aaea-d2cc-4e41-85ea-f6f8d658204f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Going to try to start instance {{(pid=116104) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 10:24:06.351629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1c4aaea-d2cc-4e41-85ea-f6f8d658204f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 202 len: 0 microversion: 2.1 time: 0.117797 Nov 23 10:24:06.352259 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 473/953] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:24:06 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:06.361731 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:06.362407 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:06.368242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.368714 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.369469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.369939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.528206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:06.541522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d2d1b2a-2fcd-4f87-8023-5b0f86dcc002 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1708 microversion: 2.1 time: 0.183944 Nov 23 10:24:06.542582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 481/954] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:06 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:06.808317 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:06.809305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:06.815448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.815890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.816669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:06.817102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:06.900645 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aa082050-0c76-449a-bc4e-18678db2aed3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 32161 microversion: 2.20 time: 0.096350 Nov 23 10:24:06.901791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 474/955] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:06 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 32161 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:07.569556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:07.570268 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:07.577372 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:07.578738 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:07.580149 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:07.580890 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:07.719839 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:07.727658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c24f5802-3446-4104-a220-9b4b289b70a7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1708 microversion: 2.1 time: 0.162004 Nov 23 10:24:07.728237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 482/956] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:07 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:07.913421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:07.914384 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:07.921162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:07.921609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:07.922905 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:07.923338 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.012935 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ac72e12-e4de-4605-a675-41f7480b504a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 32740 microversion: 2.20 time: 0.103789 Nov 23 10:24:08.013586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 475/957] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:07 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 32740 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:08.652710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:08.653422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:08.659753 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.660206 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.660980 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.661513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.685892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lazy-loading 'flavor' on Instance uuid 31725bd4-10a1-47d8-a7cb-b197d3689e6b {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:24:08.747436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:08.748555 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:08.756573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.757023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.757856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.758318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.771051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-75e5f17f-3550-4726-bcd9-69cb3507386a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "POST /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.121867 Nov 23 10:24:08.772257 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 483/958] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:24:08 2021] POST /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:08.783357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:08.784822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:08.791842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.792453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.793285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:08.797845 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:08.918392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:08.927950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-094bf8a1-cdec-48f3-954a-c147788af095 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1712 microversion: 2.1 time: 0.185033 Nov 23 10:24:08.928539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 476/959] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:08 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1712 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:08.946686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:08.954067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97c81b7f-d97e-4e7c-a4ee-e25ad216ee57 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.176275 Nov 23 10:24:08.954631 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 484/960] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:08 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:09.024431 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:09.025385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:09.032140 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:09.032578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:09.033376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:09.033834 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:09.125655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e577c423-3787-45da-980f-dc186c8674bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 33381 microversion: 2.20 time: 0.104744 Nov 23 10:24:09.126430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 477/961] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:09 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 33381 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:09.971173 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:09.971822 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:09.978311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:09.978798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:09.979568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:09.980000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:10.116209 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:10.123353 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f445ac36-f286-4e8b-9251-0ae3220915c9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.155829 Nov 23 10:24:10.123917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 485/962] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:09 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:10.139417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:10.140437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:10.148055 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:10.148539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:10.149311 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:10.149780 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:10.243339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef781215-cddf-4168-a2cd-e88a8b80e354 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 34049 microversion: 2.20 time: 0.107747 Nov 23 10:24:10.243995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 478/963] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:10 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 34049 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:11.140073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:11.140754 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:11.147041 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:11.147489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:11.148267 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:11.148704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:11.256138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:11.257353 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:11.265373 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:11.265867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:11.266663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:11.267102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:11.283847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:11.294399 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0782b995-eca6-4c85-8ad4-819d7bfec843 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.157901 Nov 23 10:24:11.294997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 486/964] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:11 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:11.357609 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-754c8b99-9a8e-485e-92c7-6433138b48fd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 35051 microversion: 2.20 time: 0.105371 Nov 23 10:24:11.358335 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 479/965] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:11 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 35051 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:12.312964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:12.313576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:12.320051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:12.320502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:12.321291 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:12.321757 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:12.372543 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:12.374252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:12.385794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:12.386436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:12.388203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:12.394564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:12.461823 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:12.470070 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2fe2245d-87ae-4311-aa97-8a1ab1d57952 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.161281 Nov 23 10:24:12.470677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 487/966] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:12 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:12.493214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d542bb0-fe3b-48c2-a9b7-f91eb22b2005 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 35832 microversion: 2.20 time: 0.126797 Nov 23 10:24:12.493927 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 480/967] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:12 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 35832 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:13.487856 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:13.488711 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:13.496953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:13.497398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:13.498392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:13.498821 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:13.508111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:13.509250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:13.517673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:13.518153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:13.518956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:13.519396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:13.634283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2f9c8e7-3a8a-428b-9166-daad0ff5fd6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 36817 microversion: 2.20 time: 0.130150 Nov 23 10:24:13.634943 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 481/968] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:13 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 36817 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:13.657332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:13.666765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bcfeb087-45e5-465c-9a74-29c02a77ec2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.183052 Nov 23 10:24:13.667343 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 488/969] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:13 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:14.647442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:14.648406 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:14.655389 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:14.655826 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:14.657184 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:14.657612 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:14.684075 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:14.684686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:14.692543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:14.692987 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:14.693813 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:14.694245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:14.754362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-452d86fd-3330-4f69-82a3-177a41eef0e0 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 37702 microversion: 2.20 time: 0.110752 Nov 23 10:24:14.755291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 482/970] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:14 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 37702 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:14.836558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:14.844214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0b4dc80-fefc-47ff-9eb0-4e9c3e8be6a0 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.163638 Nov 23 10:24:14.844816 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 489/971] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:14 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:15.767312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:15.768570 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:15.777967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:15.778421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:15.779584 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:15.780409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:15.863879 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:15.864652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:15.872617 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:15.873089 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:15.874027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:15.874486 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:15.881647 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-977b5b83-21aa-4386-b303-71336f07d274 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 38253 microversion: 2.20 time: 0.118795 Nov 23 10:24:15.888318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 483/972] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:15 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 38253 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:16.037220 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:16.051522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ad96811-5f88-4f4c-96fe-dac4c5661565 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.191743 Nov 23 10:24:16.052125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 490/973] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:15 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:16.896716 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:16.897729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:16.904730 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:16.905180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:16.906151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:16.906523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:16.975906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd37dd6c-3401-4819-963f-2dcedcd005a1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 38253 microversion: 2.20 time: 0.083118 Nov 23 10:24:16.976589 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 484/974] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:16 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 38253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:17.068412 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:17.068991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:17.075397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:17.075840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:17.076614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:17.077049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:17.213446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:17.221550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-59f4b025-f8d0-4edf-8feb-a77a757c4bcb tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.156752 Nov 23 10:24:17.222165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 491/975] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:17 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:17.988536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:17.989577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:17.997534 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:17.997997 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:17.998795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:17.999228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:18.093959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c5f1e9a8-760b-4d54-96f6-8829e3c566e1 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 200 len: 38394 microversion: 2.20 time: 0.109283 Nov 23 10:24:18.094717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 485/976] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:17 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 38394 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:18.104503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:18.105106 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:18.112444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:18.112894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:18.113676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:18.114210 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:18.139261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa8e488b-63eb-4e3a-ad21-b44d8699685b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/ips" status: 200 len: 151 microversion: 2.20 time: 0.038332 Nov 23 10:24:18.139852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 492/977] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Nov 23 10:24:18 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:24:18.241920 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:18.242525 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:18.250245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:18.251392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:18.251702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:18.252133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:18.454693 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:18.462409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53989303-7cae-4a4f-936c-d9923fab1387 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.224955 Nov 23 10:24:18.465906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 486/978] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:18 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:19.482759 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:19.483380 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:19.491893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:19.492456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:19.493002 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:19.493543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:19.661470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:19.672635 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ab86f4f-b371-4255-a105-2855da9ef55a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.195246 Nov 23 10:24:19.673335 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 493/979] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:19 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:20.579371 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:20.579942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:20.586505 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.586955 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:20.587740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.588171 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:20.612758 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lazy-loading 'flavor' on Instance uuid efd01d9c-062b-405f-81dc-54aeddf0c592 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:24:20.701292 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:20.704095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:20.712232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.712818 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:20.713501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.713997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:20.894780 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:20.904086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92a8d5eb-a5df-4202-9632-5a262ed8b85a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.209314 Nov 23 10:24:20.904671 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 494/980] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:20 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:20.919350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b22aa3c2-66e6-46b3-bffb-f26fa946b12a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 202 len: 0 microversion: 2.20 time: 0.343702 Nov 23 10:24:20.920009 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 487/981] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:20 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:24:20.930860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:20.931662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:20.940332 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.940799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:20.941858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:20.942331 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:21.099508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:21.108069 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:21.110114 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:21.111373 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b4080c71-1c90-4a78-8433-3d50f4a360d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.186495 Nov 23 10:24:21.112199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 495/982] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:20 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:21.925269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:21.926616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:21.937666 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:21.938273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:21.940450 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:21.941849 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.104026 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:22.114789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-02500a2c-15c3-4e9e-acb7-47c4272632d9 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1571 microversion: 2.1 time: 0.195829 Nov 23 10:24:22.115692 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 488/983] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:21 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:22.134244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:22.134503 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:22.135186 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:22.135426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:22.145196 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.145422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.145986 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.146112 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.147284 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.147392 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.147998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.148108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.257381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eff47274-846e-406a-ba07-a7656dd45dd7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "POST /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.129360 Nov 23 10:24:22.258262 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 496/984] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:24:22 2021] POST /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:22.266997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:22.267613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:22.273651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.274217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.276802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:22.277761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:22.306417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:22.319151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:22.325180 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:22.326600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ced41f5-84d0-4bc0-8a48-c928317f60bc tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.198482 Nov 23 10:24:22.328340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 489/985] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:22 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:24:22.465524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:22.474886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b3a2dc5-75e1-4c82-b027-90ad205118e2 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1579 microversion: 2.1 time: 0.212302 Nov 23 10:24:22.475470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 497/986] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:22 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:23.346355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:23.347142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:23.353767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.354212 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.354977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.355404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.479729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:23.481400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:23.488929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.489494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.490479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.490908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.512839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:23.521562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:23.523207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:23.524464 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb0e2e44-70ee-4abc-9177-6842f1b3e567 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.183268 Nov 23 10:24:23.535626 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 490/987] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:23 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:23.535626 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:23.535626 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:23.539957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.540506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.541492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.541941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.588180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c682f009-b222-4ab2-8c3e-28a98a21876b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action" status: 202 len: 0 microversion: 2.1 time: 0.111930 Nov 23 10:24:23.589260 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 498/988] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:24:23 2021] POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:24:23.598773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:23.599400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:23.605851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.606315 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.607101 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:23.607526 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:23.790293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:23.804272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abc0d5f3-7a31-41e4-aec6-57f659beaf7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1521 microversion: 2.1 time: 0.277584 Nov 23 10:24:23.804897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 491/989] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:23 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:23.828166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:23.839304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-494648ac-55cf-497e-ae4c-7dca8f2f3f15 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1753 microversion: 2.1 time: 0.244640 Nov 23 10:24:23.839870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 499/990] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:23 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:24.544414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:24.545183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:24.555292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.555897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:24.556825 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.557359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:24.822755 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:24.833387 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:24.834344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:24.835984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:24.839221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:24.841173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df6e61eb-e8dd-4441-be7a-08b3c46df766 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.300348 Nov 23 10:24:24.853717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.854058 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 492/991] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:24 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:24.854175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:24.854175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.854175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:24.861937 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:24.863452 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:24.872140 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.872741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:24.873662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:24.874123 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:25.031401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:25.043840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d6c45af-4107-4135-bcee-c8a8befa249f tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.214143 Nov 23 10:24:25.044785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 500/992] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:24 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:25.164340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:25.176650 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-11bf6251-406c-4e80-a38b-62fb0f72e7e9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.319748 Nov 23 10:24:25.177802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 493/993] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:24 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:25.864285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:25.864882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:25.871178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:25.871614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:25.872422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:25.872841 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.026805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:26.035692 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:26.037175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:26.038348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-424e5ddd-27c0-4ef8-ab0f-e87badd53068 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.178311 Nov 23 10:24:26.038915 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 501/994] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:25 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:26.074228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:26.075081 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:26.083683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:26.084433 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.085784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:26.086522 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.197481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:26.198513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:26.206928 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:26.207555 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.208457 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:26.209114 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.258462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:26.266809 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a0a03bfe-c930-4760-99a8-fa84591b055e tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.197741 Nov 23 10:24:26.267405 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 494/995] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:26 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:26.388581 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:26.398758 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e40cb29e-c787-4665-b7cf-828340fb8993 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.207180 Nov 23 10:24:26.399514 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 502/996] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:26 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:26.546502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-e1cbd5a2-38c6-4447-90a2-df9fb9368ae6 req-ecf2131b-5a62-4368-82a5-5bb3b66a39d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "name": "network-vif-unplugged", "status": "completed", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:26.549843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:24:26.549843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:24:26.557741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e1cbd5a2-38c6-4447-90a2-df9fb9368ae6 req-ecf2131b-5a62-4368-82a5-5bb3b66a39d5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:26.558187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-e1cbd5a2-38c6-4447-90a2-df9fb9368ae6 req-ecf2131b-5a62-4368-82a5-5bb3b66a39d5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:26.571627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-e1cbd5a2-38c6-4447-90a2-df9fb9368ae6 req-ecf2131b-5a62-4368-82a5-5bb3b66a39d5 service nova] Creating event network-vif-unplugged:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:24:26.580146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-e1cbd5a2-38c6-4447-90a2-df9fb9368ae6 req-ecf2131b-5a62-4368-82a5-5bb3b66a39d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038365 Nov 23 10:24:26.580768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 495/997] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:24:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:24:27.056791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:27.057612 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:27.065330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.065929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.066817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.067295 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.223278 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:27.231422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:27.232915 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:27.234638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbb1e9f9-fa61-47b0-969a-c28bc0b61749 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.181766 Nov 23 10:24:27.235217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 503/998] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:27 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:27.291135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:27.291838 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:27.300139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.300592 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.301386 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.301873 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.427118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:27.428276 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:27.440984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.441577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.442857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:27.443478 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:27.454395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:27.462216 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6e30137f-5868-41cf-bf98-c1b3ed2d2ec6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.175138 Nov 23 10:24:27.462802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 496/999] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:27 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:27.618823 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:27.627421 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11c7f4f7-ec67-4a1a-8b9d-ecc5b241c847 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.207549 Nov 23 10:24:27.628025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 504/1000] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:27 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:28.256699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:28.257869 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:28.269043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.269873 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.271429 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.272194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.424855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:28.433949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:28.435975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:28.437792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8bc8c406-d0d2-4229-8a59-0c1c1d6349be tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.188602 Nov 23 10:24:28.438431 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 497/1001] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:28 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:28.480627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:28.481391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:28.488099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.488538 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.489321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.489779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.649270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:28.650397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:28.659767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.660548 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.661950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:28.662701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:28.666017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:28.678326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dde0c154-ce79-40e5-b82b-727488b569ca tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.201096 Nov 23 10:24:28.679382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 505/1002] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:28 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:28.851275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:28.859856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3ef12ac-6784-4fba-9746-5e1859a0c665 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.219317 Nov 23 10:24:28.860438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 498/1003] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:28 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:29.460489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:29.461108 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:29.467797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.469137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.470397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.470887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.608165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:29.616177 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:29.617658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:29.618816 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77de5223-0908-4c49-b09d-ff8b987b3a85 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.164733 Nov 23 10:24:29.619384 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 506/1004] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:29 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:29.700479 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:29.701256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:29.710222 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.710978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.712363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.713106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.881719 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:29.882613 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:29.893216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.894049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.895472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:29.896251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:29.901049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:29.908890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48418806-87a6-4c20-a339-7c42697fa226 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.212119 Nov 23 10:24:29.910061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 499/1005] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:29 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:30.068868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:30.077027 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f6a5c71-0d10-4836-ab05-e75281af7305 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.201667 Nov 23 10:24:30.078181 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 507/1006] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:29 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:30.639002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:30.639627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:30.646560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:30.647008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:30.647789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:30.648221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:30.830107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:30.835913 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:30.837501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:30.838741 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f59269c3-bf22-444e-9f2a-05a45e009bc3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.204843 Nov 23 10:24:30.839402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 500/1007] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:30 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:30.926977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:30.927646 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:30.934431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:30.934872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:30.935704 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:30.936137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:31.094680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:31.095657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:31.096287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:31.102411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:31.102852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:31.103649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:31.104057 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eec965c6-e2e4-4443-b00c-fd33cf3af213 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.180888 Nov 23 10:24:31.104208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:31.104651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 508/1008] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:30 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:31.267537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:31.276514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c074074a-8cdb-43fc-8585-9fdf1007b97a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.184477 Nov 23 10:24:31.277514 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 501/1009] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:31 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:31.857014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:31.857528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:31.863971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:31.864418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:31.865211 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:31.865652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:32.054935 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:32.065876 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:32.067460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:32.068662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79837ab5-7b43-4641-beec-ff99f106f263 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.215477 Nov 23 10:24:32.069250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 509/1010] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:31 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:32.125244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:32.126374 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:32.135204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:32.135648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:32.136438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:32.136870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:32.293664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:32.300877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:32.301791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:32.305595 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb9005e9-371c-4c03-9038-a316a43d2ac6 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1577 microversion: 2.1 time: 0.187496 Nov 23 10:24:32.306572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 502/1011] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:32 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:32.309281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:32.309926 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:32.310858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:32.311947 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:32.520764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:32.531736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c6b1568-23a6-4a38-81a5-b6e63b4dcde6 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.234755 Nov 23 10:24:32.532368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 510/1012] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:32 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:33.088774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:33.089426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:33.096243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.096692 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.097543 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.098017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.247984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:33.256717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:33.258219 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:33.259383 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-76416408-4b20-4497-9fa5-7d0217c65c15 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.174372 Nov 23 10:24:33.259942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 503/1013] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:33 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:33.327658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:33.328269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:33.334864 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.335299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.336090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.336517 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.507347 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:33.515525 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a9c9156-a23f-430e-a533-3865d4445d2a tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1564 microversion: 2.1 time: 0.191663 Nov 23 10:24:33.516115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 511/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:33 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:33.550380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:33.551201 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:33.558727 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.559183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.559998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:33.560440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:33.764191 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:33.776362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75794816-c47f-444c-9885-e30bafd4d2c9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.230451 Nov 23 10:24:33.776945 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 504/1015] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:33 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:34.281510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:34.282196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:34.290659 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:34.291379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:34.292777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:34.293540 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:34.485023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:34.494566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:34.497127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:34.498741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90b97c00-52ff-41e7-b8e4-564425b45dcb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.222047 Nov 23 10:24:34.500066 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 512/1016] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:34 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:24:34.595373 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-47e3bcad-6e06-4a68-ace8-b396475bdb06 req-d50137d3-03d8-4bc1-9446-2021b3c2cce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "name": "network-vif-plugged", "status": "completed", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:34.597731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:24:34.597731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:24:34.610564 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-47e3bcad-6e06-4a68-ace8-b396475bdb06 req-d50137d3-03d8-4bc1-9446-2021b3c2cce3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:34.611013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-47e3bcad-6e06-4a68-ace8-b396475bdb06 req-d50137d3-03d8-4bc1-9446-2021b3c2cce3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:34.623724 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-47e3bcad-6e06-4a68-ace8-b396475bdb06 req-d50137d3-03d8-4bc1-9446-2021b3c2cce3 service nova] Creating event network-vif-plugged:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:24:34.629290 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-47e3bcad-6e06-4a68-ace8-b396475bdb06 req-d50137d3-03d8-4bc1-9446-2021b3c2cce3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038002 Nov 23 10:24:34.630317 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 505/1017] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:24:34.795557 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:34.796163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:34.802494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:34.803149 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:34.804054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:34.804490 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:34.966689 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:34.979825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30a83c67-6501-4f20-8521-ad698b6f9b8a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.187808 Nov 23 10:24:34.980835 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 513/1018] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:34 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:35.529013 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:35.529872 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:35.537565 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:35.538139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:35.539002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:35.539529 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:35.694124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:35.702192 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:35.703672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:35.704806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2b017b48-20c0-491c-8f76-300ca04ce199 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.181129 Nov 23 10:24:35.705374 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 506/1019] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:35 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:35.999449 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:36.000242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:36.006532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:36.006984 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:36.007769 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:36.008202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:36.186605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:36.194712 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e997e3d1-9b86-4ba9-b7f1-29fe49ab7a2a tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.199325 Nov 23 10:24:36.195300 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 514/1020] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:35 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:36.723879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:36.724494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:36.731627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:36.732109 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:36.732985 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:36.733442 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:36.876572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:36.885296 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:36.886792 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:36.887953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ebd6fdf-2489-4a02-b1d9-ade24941ef5a tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1743 microversion: 2.20 time: 0.168009 Nov 23 10:24:36.888507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 507/1021] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:36 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:37.212411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:37.213050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:37.219996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:37.220434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:37.221209 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:37.221635 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:37.378648 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:37.386381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-de104c5b-bf99-4217-8fbf-49dfb00f0209 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.177814 Nov 23 10:24:37.386948 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 515/1022] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:37 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:37.907669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:37.908550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:37.914957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:37.915400 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:37.916224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:37.917232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:38.068697 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:38.077909 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:38.078936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:38.080088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-880c0d2d-b5c1-4583-846e-5e8c203941ee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1743 microversion: 2.20 time: 0.177036 Nov 23 10:24:38.080655 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 508/1023] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:37 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:38.402936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:38.403651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:38.410756 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:38.411201 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:38.411985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:38.412422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:38.572892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:38.584200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c330282-35c9-4f08-a43a-e7de03e66de9 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.185047 Nov 23 10:24:38.584790 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 516/1024] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:38 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:39.098286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:39.098885 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:39.105404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:39.105944 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:39.106858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:39.107640 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:39.269155 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:39.281944 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:39.285336 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:39.287539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c0783d3-c439-4e7c-9a4f-ad81dae59dde tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1743 microversion: 2.20 time: 0.192637 Nov 23 10:24:39.288879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 509/1025] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:39 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:39.602726 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:39.603788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:39.615207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:39.615207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:39.615207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:39.615207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:39.806162 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:39.820398 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99e815c9-2c74-4c75-ad18-6925c14ca8c7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.221375 Nov 23 10:24:39.821371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 517/1026] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:39 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:40.309054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:40.310205 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:40.317949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:40.319364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:40.320276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:40.320745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:40.565746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:40.587118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:40.590685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:40.594271 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d02a934-fc2a-4d71-b67a-72aca094cc79 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.290862 Nov 23 10:24:40.595159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 510/1027] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:40 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:40.785681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-7aea78d0-d214-4c69-9e3b-523e61e8c5b6 req-e95dde74-fea1-451c-91a0-c0052b19ae6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "name": "network-vif-plugged", "status": "completed", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:40.788018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:24:40.788018 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:24:40.810819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-7aea78d0-d214-4c69-9e3b-523e61e8c5b6 req-e95dde74-fea1-451c-91a0-c0052b19ae6e service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:40.811309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-7aea78d0-d214-4c69-9e3b-523e61e8c5b6 req-e95dde74-fea1-451c-91a0-c0052b19ae6e service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:40.841882 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:40.842316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-7aea78d0-d214-4c69-9e3b-523e61e8c5b6 req-e95dde74-fea1-451c-91a0-c0052b19ae6e service nova] Creating event network-vif-plugged:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:24:40.844155 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:40.853091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:40.854003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:40.855341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:40.856472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:40.864762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-7aea78d0-d214-4c69-9e3b-523e61e8c5b6 req-e95dde74-fea1-451c-91a0-c0052b19ae6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086273 Nov 23 10:24:40.870898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 518/1028] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:24:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:24:41.087004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:41.099304 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6ad89e88-3792-4ed0-8ac9-11ec64db116b tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.263105 Nov 23 10:24:41.112341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 511/1029] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:40 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:41.633748 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:41.635280 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:41.644789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:41.645534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:41.646907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:41.647662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:41.832382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:41.846598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:41.849260 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:41.851570 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a85736e5-1b3b-4152-8d4c-c3ab1c6c01c8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.223973 Nov 23 10:24:41.852997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 519/1030] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:41 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:42.125436 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:42.128106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:42.139560 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:42.140499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:42.141738 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:42.142896 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:42.391597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:42.402471 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93b11fc7-925b-4691-9b8f-2ff847c42a51 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.282869 Nov 23 10:24:42.406264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 512/1031] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:42 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:42.883751 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:42.885155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:42.895905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:42.897014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:42.898423 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:42.899107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:43.121404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:43.130066 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:43.131961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:43.133443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-de255624-b205-4a9f-bf6d-f6c181841f06 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.256593 Nov 23 10:24:43.134500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 520/1032] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:42 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:24:43.423998 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:43.425941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:43.438751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:43.439897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:43.441204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:43.442111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:43.728799 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:43.749914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1952bb16-d007-4006-ba6e-2750ecf9fea2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.331720 Nov 23 10:24:43.762805 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 513/1033] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:43 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:44.158337 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:44.166442 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:44.180416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:44.181938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:44.183576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:44.184552 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:44.410299 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:44.429316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:44.431159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:44.432610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1dc41119-5fbd-48eb-87cb-4930bb224026 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.279747 Nov 23 10:24:44.433403 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 521/1034] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:44 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:44.780754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:44.781807 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:44.791372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:44.792657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:44.794424 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:44.795232 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:45.017521 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:45.047388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a89be283-c5e7-4ab5-b288-9751afe3214f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1758 microversion: 2.1 time: 0.272654 Nov 23 10:24:45.048403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 514/1035] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:44 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:45.464297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:45.466502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:45.484827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:45.486091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:45.487628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:45.488684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:45.736052 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:45.754458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:45.757304 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:45.759676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80d07162-b6f2-411a-8837-a73c1fd4a6dd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.302164 Nov 23 10:24:45.773766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 522/1036] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:45 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:46.074939 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:46.076054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:46.085718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:46.086427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:46.087686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:46.088348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:46.327823 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:46.341737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9d141fc6-2479-40a7-af66-a23e3280be2f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1761 microversion: 2.1 time: 0.271512 Nov 23 10:24:46.341737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 515/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:46 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1761 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:46.787577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:46.788177 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:46.797886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:46.798998 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:46.799338 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:46.800041 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:47.019323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:47.027730 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:47.029214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:47.030950 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d93a18aa-12a8-4150-9874-93ccb7a93f44 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.247647 Nov 23 10:24:47.046571 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 523/1038] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:46 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:48.056967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:48.058145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:48.066002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:48.066503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:48.067359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:48.067848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:48.291814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:48.319221 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:48.322584 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:48.324859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e75f508-7614-44d4-8b32-025d7b2d3aee tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.273844 Nov 23 10:24:48.327235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 516/1039] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:48 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:49.353444 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:49.354776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:49.364533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:49.366005 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:49.367532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:49.368656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:49.596110 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:49.605092 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:49.606908 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:49.608003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dfb5524-06a0-4278-b568-908fadac3fe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.262563 Nov 23 10:24:49.619785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 524/1040] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:49 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:50.630254 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:50.631403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:50.643717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:50.644491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:50.646010 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:50.646789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:50.727603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:50.731183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:50.742137 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:50.742926 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:50.744545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:50.745618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:50.841953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:50.856848 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:50.859072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lazy-loading 'services' on Instance uuid 7057a553-2d1e-42cd-871a-a866b56242da {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:24:50.859879 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:50.861980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-218bf7df-3a2b-465b-ab9e-7c808a6684d5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1738 microversion: 2.20 time: 0.237513 Nov 23 10:24:50.862977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 517/1041] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:50 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:50.932944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2b0c04a8-fcff-4fc4-8a1f-e6b442fe86ac tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments/8469e35b-f5e4-4351-b62f-925c7e3da7be" status: 202 len: 0 microversion: 2.1 time: 0.211456 Nov 23 10:24:50.933549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 525/1042] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:24:50 2021] DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments/8469e35b-f5e4-4351-b62f-925c7e3da7be => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:51.887667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:51.888550 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:51.895686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:51.896129 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:51.896922 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:51.897356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:52.081123 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c643dd0-e593-4763-a6b8-759dbcf15212 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:52.087961 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c643dd0-e593-4763-a6b8-759dbcf15212 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:52.089265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c643dd0-e593-4763-a6b8-759dbcf15212 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:52.112705 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c643dd0-e593-4763-a6b8-759dbcf15212 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Going to try to stop instance {{(pid=116103) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 10:24:52.137208 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:52.151577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:52.154193 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:52.156231 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5d731c53-7356-40cd-93d6-7bc5b11bea6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1720 microversion: 2.20 time: 0.272555 Nov 23 10:24:52.156836 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 518/1043] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:51 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:52.160045 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c643dd0-e593-4763-a6b8-759dbcf15212 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 202 len: 0 microversion: 2.1 time: 0.083954 Nov 23 10:24:52.160674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 526/1044] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:24:52 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:24:52.172226 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:52.172854 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:52.179855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:52.180372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:52.181547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:52.182023 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:52.346088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:52.353687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d25c2b0f-15c9-4d0c-8dd6-908bcf3c05bc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.185198 Nov 23 10:24:52.354277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 519/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:52 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:53.182857 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:53.184147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:53.194861 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:53.195676 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:53.197088 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:53.197922 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:53.371412 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:53.372276 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:53.378288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:53.378739 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:53.379197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:53.379537 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:53.379975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:53.390062 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:53.391559 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:53.392716 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c139cf6-491e-4ab0-b13d-9f97d799de8e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1720 microversion: 2.20 time: 0.218277 Nov 23 10:24:53.393293 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 527/1046] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:53 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:53.537956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:53.545914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5132c8c8-0f99-4298-9cbe-7b2467b408c6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.178001 Nov 23 10:24:53.546503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 520/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:53 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:54.414401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:54.415197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:54.423229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.423867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.425017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.425605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.567915 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:54.568759 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:54.575763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.576784 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.578135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.578942 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.632378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:54.648058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:54.652303 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:54.655773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84c09169-51b7-4117-b436-1fa193624299 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1723 microversion: 2.20 time: 0.243770 Nov 23 10:24:54.666470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 528/1048] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:54 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:54.679793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ff681d0-26fc-4d7b-b367-6ac689e193d2"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:54.681474 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:54.689000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.689900 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.690898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.691502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.781403 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:54.797849 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ae92251a-4c68-4d38-9ddd-a406ae521530 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.233392 Nov 23 10:24:54.799460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 521/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:54 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:54.806985 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-c32a0eb3-6da3-4573-8b4f-f84a9ae68187 req-20888176-3828-4d2c-85d7-75ecb527d6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "name": "network-vif-unplugged", "status": "completed", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:54.809355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:24:54.809355 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:24:54.819678 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c32a0eb3-6da3-4573-8b4f-f84a9ae68187 req-20888176-3828-4d2c-85d7-75ecb527d6d0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:54.820417 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c32a0eb3-6da3-4573-8b4f-f84a9ae68187 req-20888176-3828-4d2c-85d7-75ecb527d6d0 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:54.836408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.compute.server_external_events [req-c32a0eb3-6da3-4573-8b4f-f84a9ae68187 req-20888176-3828-4d2c-85d7-75ecb527d6d0 service nova] Unable to find a host for instance efd01d9c-062b-405f-81dc-54aeddf0c592. Dropping event network-vif-unplugged {{(pid=116104) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 10:24:54.837476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-c32a0eb3-6da3-4573-8b4f-f84a9ae68187 req-20888176-3828-4d2c-85d7-75ecb527d6d0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036931 Nov 23 10:24:54.838361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 522/1050] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 23 10:24:55.051346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4359f29e-ecbe-40c3-8b8f-961e0f42f28f tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378839 Nov 23 10:24:55.051974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 529/1051] 10.222.0.41 () {62 vars in 1363 bytes} [Tue Nov 23 10:24:54 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments => generated 188 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:24:55.183703 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:55.184194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:55.191163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.191483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.192296 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.192731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.440653 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc6d930c-2af8-4990-9af9-053ff7cc60d8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments/8ff681d0-26fc-4d7b-b367-6ac689e193d2" status: 202 len: 0 microversion: 2.20 time: 0.260291 Nov 23 10:24:55.441660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 523/1052] 10.222.0.41 () {60 vars in 1456 bytes} [Tue Nov 23 10:24:55 2021] DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments/8ff681d0-26fc-4d7b-b367-6ac689e193d2 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:24:55.512985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:24:55.513969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:55.521868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.522321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.523103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.523534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.626471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7e7bffdd-5c25-440f-a16d-a0b6ea7624bf tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action" status: 202 len: 0 microversion: 2.20 time: 0.119775 Nov 23 10:24:55.627138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 530/1053] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Nov 23 10:24:55 2021] POST /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:24:55.639858 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:55.640988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:55.651143 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.651860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.653294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.655001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.819042 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:55.831039 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:55.832720 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:55.833961 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99521817-5e71-4b5a-80a4-700a5b3dc6ba tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1671 microversion: 2.20 time: 0.202061 Nov 23 10:24:55.834662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 524/1054] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:55 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:24:55.843882 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:55.844637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:55.853250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.853723 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:55.854536 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:55.854971 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:56.039844 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:56.049082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eee9fa74-63d8-484e-9a1b-6bd9cafc457d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.216074 Nov 23 10:24:56.050086 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 531/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:55 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:56.863835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:56.865385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:56.875865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:56.876437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:56.877527 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:56.878302 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:57.067853 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:57.068858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:57.078172 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:57.078628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:57.079587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:57.080103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:57.219891 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:57.233047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:57.235411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:57.237060 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-95bfd885-b546-4577-8646-bc4cebfbb739 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.380688 Nov 23 10:24:57.237830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 525/1056] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:56 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:24:57.239169 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:57.247430 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-625c7338-d7fe-4110-81ba-4066e52d42ef tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.183766 Nov 23 10:24:57.248669 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 532/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:57 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:24:58.269464 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:58.270396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:58.273115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:58.275627 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:58.291686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:58.292187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:58.292885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:58.293115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:58.294199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:58.294640 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:58.294788 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:58.295715 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:58.530116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:58.533875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:58.543333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4264d89e-a566-47c5-965d-2d9be61c43b4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.278051 Nov 23 10:24:58.545096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 533/1058] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:58 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:58.559412 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:58.565860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:58.567306 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2dc04d1d-616d-4c61-b1ca-0aa8f29673c6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.305571 Nov 23 10:24:58.578523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 526/1059] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:58 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:24:59.571528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:59.573155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:59.581217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:59.581649 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:59.582479 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:59.582918 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:59.595327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:24:59.595932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:24:59.602438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:59.602890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:59.603683 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:24:59.604114 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:24:59.761002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:59.770301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:59.774229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:59.782068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0dec5b1b-3d12-487d-8b59-5f63400c7fc6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.215764 Nov 23 10:24:59.782808 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:24:59.784599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4312332-3edd-48dc-9be6-8180e10d611e tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.195888 Nov 23 10:24:59.795029 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 534/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:24:59 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:24:59.796376 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 527/1061] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:24:59 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:00.802117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:00.802957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:00.809264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:00.809733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:00.810508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:00.810941 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:00.813455 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:00.814098 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:00.820316 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:00.820762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:00.821536 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:00.821994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:00.977637 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:00.988185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:00.988432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-379efafb-3cec-44ae-94a3-8dad63d0a2bd tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.188072 Nov 23 10:25:00.988432 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 535/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:00 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:00.991387 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:00.992982 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:00.994662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-791d2073-43a8-4999-a16d-12c52b920741 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.184625 Nov 23 10:25:00.995488 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 528/1063] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:00 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:02.004207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:02.004936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:02.012043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:02.012495 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:02.013293 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:02.013808 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:02.016603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:02.017476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:02.025797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:02.026372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:02.027174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:02.027607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:02.202159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:02.210611 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b274c1a-99a7-47a1-b729-7e560ed2627f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.209940 Nov 23 10:25:02.221049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:02.221602 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 536/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:01 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:25:02.229337 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:02.231223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:02.233969 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c67dee38-119e-4330-b90c-dfeec98888e7 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.221301 Nov 23 10:25:02.235358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 529/1065] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:02 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:03.233634 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:03.234898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:03.242872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:03.243329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:03.244130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:03.244655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:03.253125 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:03.254539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:03.262867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:03.262867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:03.262867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:03.263991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:03.412404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:03.420585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-60222653-0493-4f68-bf5b-60d19c52ad1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.191377 Nov 23 10:25:03.440079 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 537/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:03 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:03.470734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:03.482443 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:03.485855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:03.487429 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26b20d74-565f-4471-a381-b02d4d17a641 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.238439 Nov 23 10:25:03.491087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 530/1067] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:03 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:04.446092 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:04.446718 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:04.454963 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:04.455415 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:04.456199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:04.456629 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:04.509059 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:04.509832 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:04.519156 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:04.519799 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:04.520693 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:04.521281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:04.664948 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:04.674831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-153b21b6-8d32-44fb-83c1-12f290210522 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.235434 Nov 23 10:25:04.675166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 538/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:04 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:04.736667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:04.758380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:04.760318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:04.762263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-656645f7-e0de-4e1d-8bcf-d271da5788d4 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.258075 Nov 23 10:25:04.763248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 531/1069] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:04 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:05.694661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:05.695862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:05.705574 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:05.706056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:05.706862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:05.710437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:05.786053 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:05.788667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:05.799348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:05.800598 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:05.802146 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:05.803060 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:05.909642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:05.926804 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-465fda6f-41ba-4132-97c7-482ca72f7986 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.236876 Nov 23 10:25:05.927811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 539/1070] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:05 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:06.064140 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:06.081057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:06.084124 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:06.086393 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ccb5e7ad-1e53-42a4-96cc-fbb51c5f7ca6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.306471 Nov 23 10:25:06.090709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 532/1071] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:05 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:06.954592 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:06.955662 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:06.965680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:06.966336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:06.968241 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:06.968840 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:07.114322 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:07.116788 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:07.128938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:07.130092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:07.131958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:07.132912 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:07.164735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:07.178533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e87d814-1f26-4e2f-be85-64eb2f797ec9 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.230318 Nov 23 10:25:07.179833 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 540/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:06 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:07.329908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:07.342530 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:07.344165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:07.345462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d751a407-393a-4a09-b6fc-34298436b586 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.238788 Nov 23 10:25:07.351269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 533/1073] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:07 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:08.207507 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:08.208453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:08.218025 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:08.218473 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:08.220129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:08.221124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:08.371991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:08.373957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:08.383737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:08.384490 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:08.386041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:08.386791 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:08.404361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:08.417357 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df8a1218-7950-4951-9295-333103a57c39 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.216994 Nov 23 10:25:08.419129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 541/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:08 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:08.589749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:08.598503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:08.600421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:08.601925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e78d8b4-4d1f-470d-9555-e7fb8bf685f6 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.236808 Nov 23 10:25:08.602960 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 534/1075] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:08 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:09.437741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:09.438401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:09.445117 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:09.445568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:09.446383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:09.446866 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:09.630578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:09.631568 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:09.632200 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:09.642168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:09.642585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dea8fc96-c3a2-4f70-b55e-c4a56c32ede8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.208329 Nov 23 10:25:09.643093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:09.643762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 542/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:09 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:09.644562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:09.645169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:09.812928 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:09.821377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:09.822907 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:09.824073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c3fc0589-53d1-4673-93f5-f8c2272c11af tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.200301 Nov 23 10:25:09.824649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 535/1077] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:09 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:10.670020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:10.670632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:10.677348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:10.677829 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:10.678620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:10.679048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:10.827073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:10.834567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77227327-c7f1-4b4a-8a4d-7fdca2c865b7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1676 microversion: 2.1 time: 0.168766 Nov 23 10:25:10.835144 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 543/1078] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:10 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:10.844956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:10.847142 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:10.852855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:10.853347 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:10.854169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:10.854603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:11.022689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:11.031034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:11.032631 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:11.033953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-472661ae-d161-4917-9032-8346e7606b8d tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.194362 Nov 23 10:25:11.034513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 536/1079] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:10 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:11.851849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:11.852453 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:11.858855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:11.859295 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:11.860134 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:11.860561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.002844 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:12.010554 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2b2c2563-5182-4212-a56d-f38644550125 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1653 microversion: 2.1 time: 0.162548 Nov 23 10:25:12.011247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 544/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:11 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:12.028363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62e4071c-d3d5-442b-8e4b-f3f23019bdbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:12.035330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62e4071c-d3d5-442b-8e4b-f3f23019bdbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:12.035786 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62e4071c-d3d5-442b-8e4b-f3f23019bdbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.051648 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:12.052246 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:12.058668 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62e4071c-d3d5-442b-8e4b-f3f23019bdbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Going to try to start instance {{(pid=116104) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 10:25:12.059131 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:12.059399 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.060710 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:12.061213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.118019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62e4071c-d3d5-442b-8e4b-f3f23019bdbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action" status: 202 len: 0 microversion: 2.1 time: 0.093336 Nov 23 10:25:12.118539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 537/1081] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:25:12 2021] POST /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:25:12.128932 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:12.129641 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:12.136686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:12.137148 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.138026 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:12.138547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:12.237529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:12.248831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:12.253054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:12.255349 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f88072d-b730-4c28-83d7-d072901a0a75 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.206906 Nov 23 10:25:12.256386 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 545/1082] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:12 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:12.336507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:12.344332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4149a0b5-701c-4a38-bb29-17b56dcb27d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1662 microversion: 2.1 time: 0.220241 Nov 23 10:25:12.344958 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 538/1083] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:12 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1662 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:25:13.276989 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:13.277677 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:13.286122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:13.286569 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:13.287371 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:13.287805 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:13.362620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:13.363269 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:13.371567 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:13.372297 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:13.373340 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:13.373973 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:13.517269 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:13.532306 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:13.536054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:13.538534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d71b9c86-478e-4053-b127-6b0122641829 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.265098 Nov 23 10:25:13.545893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 546/1084] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:13 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:13.625795 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:13.635277 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e72ed23-03d9-46f5-8835-66803ba91fcf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1662 microversion: 2.1 time: 0.276492 Nov 23 10:25:13.635999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 539/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:13 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:25:14.559319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:14.559892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:14.566329 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:14.566772 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:14.567547 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:14.567977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:14.653761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:14.655573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:14.665685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:14.666084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:14.667638 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:14.668235 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:14.740095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:14.750766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:14.752587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:14.753815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d02cf90b-c111-42ab-bd60-0d666011fbe8 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.198428 Nov 23 10:25:14.754389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 547/1086] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:14 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:14.849936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:14.858472 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12d81427-5d93-4e77-83d5-a5d32b1a7521 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1666 microversion: 2.1 time: 0.208300 Nov 23 10:25:14.859503 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 540/1087] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:14 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1666 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:25:15.773197 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:15.774034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:15.783109 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:15.783883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:15.784679 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:15.785111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:15.950360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:15.960924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:15.962446 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:15.963604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47da6b7f-4768-4f61-9de2-e4e0b02e3259 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.194294 Nov 23 10:25:15.964168 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 548/1088] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:15 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:25:16.785135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a0ab4b24-0375-4171-b1f1-fd6fbe8831a6 req-4e36d237-6924-4906-a7c7-2402bbf553fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "name": "network-vif-plugged", "status": "completed", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:16.786737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:25:16.786737 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:25:16.796179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a0ab4b24-0375-4171-b1f1-fd6fbe8831a6 req-4e36d237-6924-4906-a7c7-2402bbf553fd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:16.796602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a0ab4b24-0375-4171-b1f1-fd6fbe8831a6 req-4e36d237-6924-4906-a7c7-2402bbf553fd service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:16.809624 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a0ab4b24-0375-4171-b1f1-fd6fbe8831a6 req-4e36d237-6924-4906-a7c7-2402bbf553fd service nova] Creating event network-vif-plugged:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:25:16.815128 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a0ab4b24-0375-4171-b1f1-fd6fbe8831a6 req-4e36d237-6924-4906-a7c7-2402bbf553fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Nov 23 10:25:16.816014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 541/1089] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:25:16.981606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:16.982393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:16.988854 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:16.989297 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:16.990154 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:16.990624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:17.131568 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:17.149149 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:17.152008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:17.154000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a8ba8fd-7f1b-43c1-93ab-a750c6099ba2 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.175801 Nov 23 10:25:17.154855 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 549/1090] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:16 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:18.180005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:18.180734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:18.191735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:18.192499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:18.193966 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:18.194691 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:18.363620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:18.378363 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:18.381470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:18.383607 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-144983c6-f4a7-47ef-a996-5a1535f49b6b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1729 microversion: 2.20 time: 0.209198 Nov 23 10:25:18.384575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 542/1091] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:18 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:19.407584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:19.408491 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:19.415090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:19.415553 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:19.416346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:19.416785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:19.565741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:19.574562 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:19.576996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:19.578374 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57c3ae2c-0235-4397-9c98-678fe805ce01 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1716 microversion: 2.20 time: 0.175473 Nov 23 10:25:19.579000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 550/1092] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:25:19 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1716 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 10:25:27.830664 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-178807116"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:27.831725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:27.842760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:27.843227 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:27.844084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:27.844528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:28.024084 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.network.security_group_api [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Removing security group e464a0a4-a85c-4be7-9f16-69b54b3aa67a from port 95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 Nov 23 10:25:28.545748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2fdce8b9-684f-464b-8c18-938482b2aaa3 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action" status: 202 len: 0 microversion: 2.1 time: 0.721183 Nov 23 10:25:28.551544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 543/1093] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:25:27 2021] POST /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:25:28.564831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-4e776844-beaf-4e04-a50a-f4d9f0c0e028 req-2ca4c397-500e-4caf-887a-627f0f49ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:28.567543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:25:28.567543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:25:28.593401 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4e776844-beaf-4e04-a50a-f4d9f0c0e028 req-2ca4c397-500e-4caf-887a-627f0f49ecc5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:28.594785 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4e776844-beaf-4e04-a50a-f4d9f0c0e028 req-2ca4c397-500e-4caf-887a-627f0f49ecc5 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:28.619130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-4e776844-beaf-4e04-a50a-f4d9f0c0e028 req-2ca4c397-500e-4caf-887a-627f0f49ecc5 service nova] Creating event network-changed:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:25:28.631047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-4e776844-beaf-4e04-a50a-f4d9f0c0e028 req-2ca4c397-500e-4caf-887a-627f0f49ecc5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076102 Nov 23 10:25:28.646232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 551/1094] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:25:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:25:30.572001 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:30.572593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:30.578867 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:30.579321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:30.580108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:30.580544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:30.683663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lazy-loading 'services' on Instance uuid a427eeec-0a98-48cd-8098-dc1f6f44dea9 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:25:30.709901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-6062c9b1-b899-4007-88fe-6a463a8f36d0 req-54e37c65-64a8-4813-bd4e-445acce7d6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:30.711546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:25:30.711546 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:25:30.735695 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6062c9b1-b899-4007-88fe-6a463a8f36d0 req-54e37c65-64a8-4813-bd4e-445acce7d6d3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:30.736404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6062c9b1-b899-4007-88fe-6a463a8f36d0 req-54e37c65-64a8-4813-bd4e-445acce7d6d3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:30.755472 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-6062c9b1-b899-4007-88fe-6a463a8f36d0 req-54e37c65-64a8-4813-bd4e-445acce7d6d3 service nova] Creating event network-changed:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:25:30.763042 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-6062c9b1-b899-4007-88fe-6a463a8f36d0 req-54e37c65-64a8-4813-bd4e-445acce7d6d3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058074 Nov 23 10:25:30.764058 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 552/1095] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:25:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:25:30.816610 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3eea63b5-1e4c-41a7-a937-f0df34586dcc tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments/77c2a8d9-ab62-42f9-ad6b-e3063e8a491b" status: 202 len: 0 microversion: 2.1 time: 0.249811 Nov 23 10:25:30.817360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 544/1096] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:25:30 2021] DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments/77c2a8d9-ab62-42f9-ad6b-e3063e8a491b => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:25:30.832530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:30.834345 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:30.843172 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:30.843977 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:30.845488 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:30.846436 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:30.888060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-637e3aba-8b04-48cd-91a6-cccbcfe8a459 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060970 Nov 23 10:25:30.892434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 553/1097] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:25:30 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:25:31.901596 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:31.902695 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:31.910964 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:31.911779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:31.913055 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:31.914689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:31.954250 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ae1ff383-dee0-4fca-9b8e-f26c3eb4fc06 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058084 Nov 23 10:25:31.955326 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 545/1098] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:25:31 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:25:31.976320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:31.977082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:31.985859 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:31.986534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:31.987720 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:31.988317 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:32.097319 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] HTTP exception thrown: Instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 is not attached to volume 77c2a8d9-ab62-42f9-ad6b-e3063e8a491b Nov 23 10:25:32.097896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Returning 404 to user: Instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 is not attached to volume 77c2a8d9-ab62-42f9-ad6b-e3063e8a491b {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:25:32.098831 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40d3f437-2e53-474c-b5a2-f7a778a5d189 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments/77c2a8d9-ab62-42f9-ad6b-e3063e8a491b" status: 404 len: 154 microversion: 2.1 time: 0.134249 Nov 23 10:25:32.099396 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 554/1099] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:25:31 2021] DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9/os-volume_attachments/77c2a8d9-ab62-42f9-ad6b-e3063e8a491b => generated 154 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:25:33.247941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:33.248599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:33.255127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:33.255580 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:33.256362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:33.256890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:33.283266 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:25:33.378657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-87c1cf36-0f8c-4dce-b283-6a53298a95d5 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 204 len: 0 microversion: 2.1 time: 0.134032 Nov 23 10:25:33.379497 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 546/1100] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:25:33 2021] DELETE /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:25:33.392622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:33.393959 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:33.403835 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:33.404651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:33.406010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:33.406775 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:33.575165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:33.586976 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-43871b32-200f-4baa-8e33-82dc3b90ead7 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1556 microversion: 2.1 time: 0.200883 Nov 23 10:25:33.587743 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 555/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:33 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:34.614613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:34.615690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:34.628474 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:34.628925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:34.629754 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:34.630198 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:34.790881 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:34.799135 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13eb06d9-43ff-4116-98d8-bc42273b7ef2 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1556 microversion: 2.1 time: 0.191674 Nov 23 10:25:34.799716 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 547/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:34 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1556 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:35.822076 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:35.822766 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:35.830225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:35.830674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:35.831467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:35.831905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:35.988147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b8807bd524d81ac3d0ae16853f515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f502da36fe4189bebca087c4fca337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:35.996399 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12f82aa7-a939-4137-884b-c63b5ca55e9f tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 200 len: 1556 microversion: 2.1 time: 0.179810 Nov 23 10:25:35.997007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 556/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:35 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:36.227127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a990a3f1-1eca-4379-81b7-35d56e73041f req-3b58ebc7-676f-4604-8ee9-1cbf0b38ed51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a427eeec-0a98-48cd-8098-dc1f6f44dea9", "name": "network-vif-deleted", "tag": "95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:36.232970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:25:36.232970 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:25:36.243151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a990a3f1-1eca-4379-81b7-35d56e73041f req-3b58ebc7-676f-4604-8ee9-1cbf0b38ed51 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:36.243602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a990a3f1-1eca-4379-81b7-35d56e73041f req-3b58ebc7-676f-4604-8ee9-1cbf0b38ed51 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:36.256994 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a990a3f1-1eca-4379-81b7-35d56e73041f req-3b58ebc7-676f-4604-8ee9-1cbf0b38ed51 service nova] Creating event network-vif-deleted:95bb8b3e-3b5c-4c15-9f96-84f6645ae6b2 for instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 on hv-cinder-80403 Nov 23 10:25:36.263894 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a990a3f1-1eca-4379-81b7-35d56e73041f req-3b58ebc7-676f-4604-8ee9-1cbf0b38ed51 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041925 Nov 23 10:25:36.264535 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 548/1104] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:25:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:25:37.016460 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:37.017236 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] [instance: a427eeec-0a98-48cd-8098-dc1f6f44dea9] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:37.024081 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:37.024576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:37.025494 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:37.025960 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:37.040868 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] HTTP exception thrown: Instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 could not be found. Nov 23 10:25:37.041467 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Returning 404 to user: Instance a427eeec-0a98-48cd-8098-dc1f6f44dea9 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:25:37.042418 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-553fb45c-31e3-4c69-b19a-77e1fe617cbd tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9" status: 404 len: 111 microversion: 2.1 time: 0.030496 Nov 23 10:25:37.042978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 557/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:37 2021] GET /compute/v2.1/servers/a427eeec-0a98-48cd-8098-dc1f6f44dea9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:25:37.051790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3313ef7e-bd14-47ab-818b-83c83a469c40 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] Calling method '.version_select at 0x7f9fe05989d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:37.070476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3313ef7e-bd14-47ab-818b-83c83a469c40 tempest-TestMinimumBasicScenario-1433546252 tempest-TestMinimumBasicScenario-1433546252-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1583072571" status: 202 len: 0 microversion: 2.1 time: 0.022689 Nov 23 10:25:37.071102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 549/1106] 10.222.0.41 () {58 vars in 1271 bytes} [Tue Nov 23 10:25:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1583072571 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:25:56.366541 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Action: 'create', calling method: .version_select at 0x7f9fd739b8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-279048301"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:56.381448 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:25:56.393050 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for user 503a487ef2034c848bf728d634073470 and project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:25:56.403043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:56.404264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:56.411637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.412176 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.413056 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.413586 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.449310 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e308fc49-2492-4ab5-a59e-ca3f03a92042 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051275 Nov 23 10:25:56.454768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 550/1107] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:25:56 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:25:56.515644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:56.516329 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:56.523707 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.524309 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.525204 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.525766 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.556507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:25:56.571902 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:25:56.577088 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for user 503a487ef2034c848bf728d634073470 and project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:25:56.590688 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93805b2b-1bb1-4f41-9eaf-9c41c6a4a394 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.402193 Nov 23 10:25:56.591764 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 558/1108] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 23 10:25:56 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:56.656575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e52bfe97-de66-460d-be20-7265b6538de1 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 204 len: 0 microversion: 2.1 time: 0.144299 Nov 23 10:25:56.658212 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 551/1109] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:25:56 2021] DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:25:56.666155 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:56.669085 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:56.680734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.682688 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.684533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:56.703427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:56.867732 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:56.881397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e7cd7f24-f099-45fc-932c-1a1405e7820a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1672 microversion: 2.1 time: 0.218641 Nov 23 10:25:56.883340 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 559/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:56 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:25:57.898977 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:57.899689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:57.907911 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:57.908369 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:57.909200 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:57.909636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:58.173162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:58.186542 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96c0feca-3b2f-468c-b945-b5d3732c3e91 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1672 microversion: 2.1 time: 0.291550 Nov 23 10:25:58.203470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 552/1111] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:57 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1672 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:58.596779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:58.597296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:58.603846 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-eb5a084e-cd51-48ae-b4c0-a71af624242e req-fde5596c-6807-40e5-9df4-779664da8b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:25:58.606101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:25:58.606101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:25:58.606378 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:58.606609 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:58.607667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:58.608265 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:58.622223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-eb5a084e-cd51-48ae-b4c0-a71af624242e req-fde5596c-6807-40e5-9df4-779664da8b84 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:58.623925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-eb5a084e-cd51-48ae-b4c0-a71af624242e req-fde5596c-6807-40e5-9df4-779664da8b84 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:58.649244 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-eb5a084e-cd51-48ae-b4c0-a71af624242e req-fde5596c-6807-40e5-9df4-779664da8b84 service nova] Creating event network-changed:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:25:58.656391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-eb5a084e-cd51-48ae-b4c0-a71af624242e req-fde5596c-6807-40e5-9df4-779664da8b84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056989 Nov 23 10:25:58.658118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 553/1112] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:25:58.670049 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:25:58.791422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07ce5a06-7cbc-41dd-8345-6602738acc32 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "DELETE /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 204 len: 0 microversion: 2.1 time: 0.197954 Nov 23 10:25:58.792813 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 560/1113] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:25:58 2021] DELETE /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 10:25:58.801931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:58.802644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:58.811908 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:58.812358 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:58.813163 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:58.813831 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:59.066515 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:59.072957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47f58b79-4d31-48fe-b4ea-3f90ac50b2c7 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1570 microversion: 2.1 time: 0.275882 Nov 23 10:25:59.073554 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 554/1114] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:58 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1570 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:25:59.207064 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:25:59.208084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:25:59.215598 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:59.217228 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:59.218860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:25:59.222802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:25:59.426214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:25:59.437871 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-25c9216c-3cc2-4675-aec0-404e631d216e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1672 microversion: 2.1 time: 0.234865 Nov 23 10:25:59.439543 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 561/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:25:59 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:00.092121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:00.094974 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:00.108592 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:00.114897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:00.118813 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:00.119630 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:00.372324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:00.380161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6538def1-41a6-4f06-80e0-8ea6cd28abdf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1452 microversion: 2.1 time: 0.291991 Nov 23 10:26:00.380717 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 555/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:00 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:00.460355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:00.465194 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:00.472257 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:00.472715 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:00.473523 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:00.473976 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:00.516094 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-d0171443-2e1c-4535-a7ea-d72c6ea13450 req-5b28b405-48bd-4c91-999c-08225c0ae4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7057a553-2d1e-42cd-871a-a866b56242da", "name": "network-vif-deleted", "tag": "1ec010d3-ad72-4866-a7e5-09f4bc87f439"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:00.518351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:00.518351 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:26:00.526770 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d0171443-2e1c-4535-a7ea-d72c6ea13450 req-5b28b405-48bd-4c91-999c-08225c0ae4e1 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:00.528234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d0171443-2e1c-4535-a7ea-d72c6ea13450 req-5b28b405-48bd-4c91-999c-08225c0ae4e1 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:00.550699 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-d0171443-2e1c-4535-a7ea-d72c6ea13450 req-5b28b405-48bd-4c91-999c-08225c0ae4e1 service nova] Creating event network-vif-deleted:1ec010d3-ad72-4866-a7e5-09f4bc87f439 for instance 7057a553-2d1e-42cd-871a-a866b56242da on hv-cinder-80403 Nov 23 10:26:00.567101 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-d0171443-2e1c-4535-a7ea-d72c6ea13450 req-5b28b405-48bd-4c91-999c-08225c0ae4e1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057303 Nov 23 10:26:00.572029 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 556/1117] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:26:00.627919 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:00.638463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-76bef6ed-c170-462e-a191-2a37d9f58b51 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 200 len: 1606 microversion: 2.1 time: 0.183970 Nov 23 10:26:00.639391 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 562/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:00 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 1606 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:01.279513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.280661 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:01.303102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.303563 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.304377 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.304923 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.349777 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54d318db-cef8-4c2c-8353-d783f2cead46 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076182 Nov 23 10:26:01.350701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 557/1119] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Nov 23 10:26:01 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:01.404094 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.404739 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:01.424722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.425084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.426153 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.426762 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.447552 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.448303 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:01.456689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.458618 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.461214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.463361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.505660 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:26:01.517281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:01.538713 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d565789d-8c6a-4d10-bc88-8ec792b4eee5 tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1384 microversion: 2.1 time: 0.137539 Nov 23 10:26:01.545308 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 563/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:01 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1384 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:01.651115 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-013050d0-7ea0-47e8-8fe0-5ff3f38ebb10 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 204 len: 0 microversion: 2.20 time: 0.206926 Nov 23 10:26:01.652782 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 558/1121] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Nov 23 10:26:01 2021] DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 23 10:26:01.660214 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.661366 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:01.662166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.666877 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:01.668580 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.669405 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.670427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.671352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.674843 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.675295 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.677797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:01.677797 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:01.689585 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. Nov 23 10:26:01.690687 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:01.702699 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c9e8be1e-54ae-4d6c-a54f-f73f5f69901c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 404 len: 111 microversion: 2.1 time: 0.050499 Nov 23 10:26:01.705142 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 564/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:01 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 10:26:01.724870 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17abdd9b-2c08-4740-bbf3-7901fbe47274 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '.version_select at 0x7f9fd738da60>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:01.752072 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17abdd9b-2c08-4740-bbf3-7901fbe47274 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604744706" status: 202 len: 0 microversion: 2.1 time: 0.040699 Nov 23 10:26:01.753737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 565/1123] 10.222.0.41 () {58 vars in 1217 bytes} [Tue Nov 23 10:26:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604744706 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:26:01.857044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:01.865637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:01.873865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:01.882999 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-46bf07d0-7788-400d-b36f-736bf11ebe66 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.225947 Nov 23 10:26:01.883619 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 559/1124] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:26:01 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:26:02.563000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:02.565044 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:02.596549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a41575ea-6234-4438-8733-8ba2390fd525 req-4e26e5d4-aa78-4506-af4f-3dacde748ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31725bd4-10a1-47d8-a7cb-b197d3689e6b", "name": "network-vif-deleted", "tag": "a1768530-de4e-4988-9151-e1eb6df9631e"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:02.598183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:02.598183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:26:02.599944 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.600619 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.601592 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.606253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.617816 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a41575ea-6234-4438-8733-8ba2390fd525 req-4e26e5d4-aa78-4506-af4f-3dacde748ff6 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.618270 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a41575ea-6234-4438-8733-8ba2390fd525 req-4e26e5d4-aa78-4506-af4f-3dacde748ff6 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.631760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a41575ea-6234-4438-8733-8ba2390fd525 req-4e26e5d4-aa78-4506-af4f-3dacde748ff6 service nova] Creating event network-vif-deleted:a1768530-de4e-4988-9151-e1eb6df9631e for instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b on hv-cinder-80403 Nov 23 10:26:02.641924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a41575ea-6234-4438-8733-8ba2390fd525 req-4e26e5d4-aa78-4506-af4f-3dacde748ff6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046349 Nov 23 10:26:02.648971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 560/1125] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:26:02.678481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.679346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.680095 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lazy-loading 'fault' on Instance uuid 31725bd4-10a1-47d8-a7cb-b197d3689e6b {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:26:02.736309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72ae5b8eb4d47f48e174c90e5398860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14da7ea5f14a4fa94558a450bc7b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:02.744604 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70016ae5-8f59-47a7-b9b5-ae36be631b0d tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 200 len: 1179 microversion: 2.1 time: 0.186541 Nov 23 10:26:02.746230 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 566/1126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:02 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 1179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:02.891470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: .version_select at 0x7f9fd750dca0>, body: {"keypair": {"name": "tempest-keypair-1771018647"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:02.902335 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:02.903034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:02.909437 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.909615 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:26:02.910015 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.910887 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:02.911422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:02.914016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:26:03.073176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:03.083374 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:03.085060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:03.086518 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f651d6d-b902-4551-bb08-f738c9a21115 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1722 microversion: 2.20 time: 0.188289 Nov 23 10:26:03.090680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 567/1127] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:26:02 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:26:03.192662 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:26:03.198600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:26:03.214493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83db3e4d-2897-43ff-b9f8-05b72fc91059 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.326869 Nov 23 10:26:03.216048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 561/1128] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Nov 23 10:26:02 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:03.763296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:03.763824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] [instance: 31725bd4-10a1-47d8-a7cb-b197d3689e6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:03.770294 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:03.770744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:03.771783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:03.772232 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:03.787869 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] HTTP exception thrown: Instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b could not be found. Nov 23 10:26:03.788773 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Returning 404 to user: Instance 31725bd4-10a1-47d8-a7cb-b197d3689e6b could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:03.789896 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f36ae94-3f9c-4b5b-a12f-d4c8c57b0bcf tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b" status: 404 len: 111 microversion: 2.1 time: 0.030912 Nov 23 10:26:03.790694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 568/1129] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:03 2021] GET /compute/v2.1/servers/31725bd4-10a1-47d8-a7cb-b197d3689e6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:26:04.129150 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:04.132749 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:04.155186 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:04.155577 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:04.156870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:04.157893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:04.163445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5234a9c5-5662-400f-9342-5a7c66237b7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] Calling method '.version_select at 0x7f9fd7430b80>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:04.215182 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5234a9c5-5662-400f-9342-5a7c66237b7c tempest-TestShelveInstance-1884889168 tempest-TestShelveInstance-1884889168-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268409533" status: 202 len: 0 microversion: 2.1 time: 0.059296 Nov 23 10:26:04.217542 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 569/1130] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Nov 23 10:26:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268409533 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:26:04.381066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:04.409601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:04.412330 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a331bd5f38e14c048ea5d71df48d19a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc019832e44730b73dbca94fd68096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:04.414701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4399542e-bd8f-4d2d-84b8-6a405c1d6637 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 200 len: 1654 microversion: 2.20 time: 0.313071 Nov 23 10:26:04.415713 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 562/1131] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:26:04 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 1654 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 10:26:04.709545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-1b0c649a-6b7e-4684-bcec-699aea0a4792 req-c0c4efd5-1d41-482f-84fb-051d4aea0391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd01d9c-062b-405f-81dc-54aeddf0c592", "name": "network-vif-deleted", "tag": "946fe950-3230-43bc-a9e6-d27b5626ea38"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:04.712614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:04.712614 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:26:04.724258 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1b0c649a-6b7e-4684-bcec-699aea0a4792 req-c0c4efd5-1d41-482f-84fb-051d4aea0391 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:04.725037 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1b0c649a-6b7e-4684-bcec-699aea0a4792 req-c0c4efd5-1d41-482f-84fb-051d4aea0391 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:04.759670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-1b0c649a-6b7e-4684-bcec-699aea0a4792 req-c0c4efd5-1d41-482f-84fb-051d4aea0391 service nova] Creating event network-vif-deleted:946fe950-3230-43bc-a9e6-d27b5626ea38 for instance efd01d9c-062b-405f-81dc-54aeddf0c592 on hv-cinder-80403 Nov 23 10:26:04.767744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-1b0c649a-6b7e-4684-bcec-699aea0a4792 req-c0c4efd5-1d41-482f-84fb-051d4aea0391 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061946 Nov 23 10:26:04.772997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 570/1132] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:26:05.437810 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:05.439428 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:05.449669 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:05.450203 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:05.451167 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:05.452342 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:05.469281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. Nov 23 10:26:05.470217 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:05.471364 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9c89670-ff60-41d0-9892-ed12ed4e20e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 404 len: 111 microversion: 2.20 time: 0.039538 Nov 23 10:26:05.472993 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 563/1133] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Nov 23 10:26:05 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 10:26:05.484084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7524a3d-f867-415b-b3b8-5606da7febe3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '.version_select at 0x7f9fd738dca0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:05.514911 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7524a3d-f867-415b-b3b8-5606da7febe3 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980886696" status: 204 len: 0 microversion: 2.20 time: 0.037092 Nov 23 10:26:05.515732 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 571/1134] 10.222.0.41 () {60 vars in 1258 bytes} [Tue Nov 23 10:26:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980886696 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 10:26:05.559486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-92636199", "imageRef": "a9536696-200b-465f-9eab-70dc5c652ed2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6acff799-0077-4cd7-98c9-c8248982bc45"}], "security_groups": [{"name": "tempest-securitygroup--129224561"}], "key_name": "tempest-keypair-1771018647", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:05.727283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] validate_networks() for [('6acff799-0077-4cd7-98c9-c8248982bc45', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:26:06.385243 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:26:06.385890 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:26:06.387362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:26:06.387850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:26:06.388397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:26:06.398126 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:06.398682 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:06.399800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:06.400278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:06.421331 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:26:06.425876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Getting quotas for user a1d5366809434d0bbeae12b0ddb9f195 and project f5e6bc65e4594796a6958f6e1d36295c. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:26:06.438034 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:26:06.441169 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9536696-200b-465f-9eab-70dc5c652ed2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:26:06.512875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a94b894e-5c15-4de4-80cf-6fc8f1675048 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.959099 Nov 23 10:26:06.519740 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 564/1135] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:26:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 10:26:06.524934 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5660d6e8-9341-4191-89da-db7904266363 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:06.525921 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5660d6e8-9341-4191-89da-db7904266363 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:06.615678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5660d6e8-9341-4191-89da-db7904266363 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:06.626652 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5660d6e8-9341-4191-89da-db7904266363 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1236 microversion: 2.1 time: 0.105268 Nov 23 10:26:06.634008 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 572/1136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:06 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1236 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:07.645337 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:07.646321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:07.659585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:07.663572 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:07.665061 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:07.665509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:07.846823 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:07.857875 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6353e18-9ed0-41c9-8a64-21a1145d86d5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1296 microversion: 2.1 time: 0.217832 Nov 23 10:26:07.858463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 565/1137] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:07 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:08.054760 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:08.055667 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:08.077851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.078624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:08.081639 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.082427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:08.124504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. Nov 23 10:26:08.125520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:08.135534 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed3b4fb0-9c7b-4713-875a-cc2564fadecb tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 404 len: 111 microversion: 2.1 time: 0.087047 Nov 23 10:26:08.137103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 573/1138] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:26:08 2021] DELETE /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:26:08.149624 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:08.150756 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: efd01d9c-062b-405f-81dc-54aeddf0c592] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:08.179425 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.180257 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:08.183611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.185924 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:08.205264 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. Nov 23 10:26:08.206222 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance efd01d9c-062b-405f-81dc-54aeddf0c592 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:08.207315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad630f43-4939-4da3-895f-58d96ac6c2e5 tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592" status: 404 len: 111 microversion: 2.1 time: 0.064283 Nov 23 10:26:08.208418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 566/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:08 2021] GET /compute/v2.1/servers/efd01d9c-062b-405f-81dc-54aeddf0c592 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:26:08.880885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:08.881798 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:08.893513 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.894526 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:08.896052 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:08.897016 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:09.240135 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:09.264865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0012f840-3c90-4edd-a8f8-580890102d7d tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.389156 Nov 23 10:26:09.265734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 574/1140] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:08 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:09.409446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:09.428771 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:09.438007 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:09.439551 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:09.446194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:09.447620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:09.509211 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. Nov 23 10:26:09.512458 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:09.513725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16a027c6-3d4d-4227-92c5-52d672cd49bd tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 404 len: 111 microversion: 2.1 time: 0.109664 Nov 23 10:26:09.515301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 567/1141] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:26:09 2021] DELETE /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:26:09.522929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:09.523893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] [instance: b6188ff0-e2b2-4465-a6c9-68b77464d49e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:09.533334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:09.536397 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:09.537434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:09.538572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:09.566116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] HTTP exception thrown: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. Nov 23 10:26:09.566956 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] Returning 404 to user: Instance b6188ff0-e2b2-4465-a6c9-68b77464d49e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:26:09.567996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-13019887-0440-49a8-8bfb-8d222fa3a01b tempest-AttachVolumeShelveTestJSON-1391962903 tempest-AttachVolumeShelveTestJSON-1391962903-project] 10.222.0.41 "GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e" status: 404 len: 111 microversion: 2.1 time: 0.048772 Nov 23 10:26:09.572550 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 575/1142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:09 2021] GET /compute/v2.1/servers/b6188ff0-e2b2-4465-a6c9-68b77464d49e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:26:10.281597 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:10.282508 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:10.290291 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:10.291095 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:10.294743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:10.295195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:10.695675 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-1f363c59-a7c4-4f96-bb89-dd484a859329 req-67d3930a-dac0-43f7-be08-676e07ac0bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6ee0e-0a95-48b7-8b0d-50548e0bc60e", "tag": "e8e96bbd-a37b-4696-abfe-810dc94c8893"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:10.697121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:10.697121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:26:10.713204 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1f363c59-a7c4-4f96-bb89-dd484a859329 req-67d3930a-dac0-43f7-be08-676e07ac0bff service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:10.713650 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1f363c59-a7c4-4f96-bb89-dd484a859329 req-67d3930a-dac0-43f7-be08-676e07ac0bff service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:10.730421 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:10.738112 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-1f363c59-a7c4-4f96-bb89-dd484a859329 req-67d3930a-dac0-43f7-be08-676e07ac0bff service nova] Creating event network-changed:e8e96bbd-a37b-4696-abfe-810dc94c8893 for instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e on hv-cinder-80403 Nov 23 10:26:10.742830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-033d8678-1a7d-4406-a552-4c1ebfa8d8c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.464679 Nov 23 10:26:10.743811 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 568/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:10 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:10.765776 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-1f363c59-a7c4-4f96-bb89-dd484a859329 req-67d3930a-dac0-43f7-be08-676e07ac0bff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073599 Nov 23 10:26:10.767586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 576/1144] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:26:11.760332 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:11.760939 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:11.768104 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:11.768553 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:11.769333 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:11.769800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:12.529938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:12.538106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4f064ff-a926-4a20-8657-1d9784ef4f15 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.781378 Nov 23 10:26:12.538690 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 569/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:11 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:13.556837 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:13.558875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:13.566010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:13.566461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:13.567586 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:13.568190 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:13.725962 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:13.737416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bed2557e-ebb1-4df5-a646-654cc4231e48 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.185025 Nov 23 10:26:13.738067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 577/1146] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:13 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:14.755860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:14.757237 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:14.768584 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:14.770230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:14.771835 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:14.773293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:15.145108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:15.154591 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5e40564-01df-4068-98b7-e303b4734d81 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.402344 Nov 23 10:26:15.172459 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 570/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:14 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:16.187979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:16.188573 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:16.196382 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:16.196875 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:16.198076 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:16.199524 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:16.475815 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1468888092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-279048301", "security_groups": [{"name": "tempest-secgroup-smoke-20173602"}], "block_device_mapping_v2": [{"uuid": "1273e36c-1f34-434c-8a02-017671ee988f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31033c80-6f35-48ab-a7f7-d83be34974ec"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:16.565187 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:16.606736 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-160e8a07-d949-4f11-b3ca-fcd31af55df6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.423352 Nov 23 10:26:16.607336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 578/1148] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:16 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:16.670076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] validate_networks() for [('31033c80-6f35-48ab-a7f7-d83be34974ec', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:26:17.383952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:26:17.385160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:26:17.386318 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:26:17.387573 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:26:17.389367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:26:17.410658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:17.411494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:17.412729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:17.414448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:17.484839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:26:17.495851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-82320a26-609b-4659-ac3e-394e3c5c9e91 req-acb7c9dd-973b-45f4-bcba-1fcbade548b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6ee0e-0a95-48b7-8b0d-50548e0bc60e", "name": "network-vif-plugged", "status": "completed", "tag": "e8e96bbd-a37b-4696-abfe-810dc94c8893"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:17.499030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:17.499030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:26:17.508043 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for user 503a487ef2034c848bf728d634073470 and project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:26:17.517932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-82320a26-609b-4659-ac3e-394e3c5c9e91 req-acb7c9dd-973b-45f4-bcba-1fcbade548b9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:17.518489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-82320a26-609b-4659-ac3e-394e3c5c9e91 req-acb7c9dd-973b-45f4-bcba-1fcbade548b9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:17.532254 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-82320a26-609b-4659-ac3e-394e3c5c9e91 req-acb7c9dd-973b-45f4-bcba-1fcbade548b9 service nova] Creating event network-vif-plugged:e8e96bbd-a37b-4696-abfe-810dc94c8893 for instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e on hv-cinder-80403 Nov 23 10:26:17.539093 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-82320a26-609b-4659-ac3e-394e3c5c9e91 req-acb7c9dd-973b-45f4-bcba-1fcbade548b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047975 Nov 23 10:26:17.540264 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 579/1149] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:26:17.618931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:26:17.622884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1273e36c-1f34-434c-8a02-017671ee988f',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:26:17.626746 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:17.627791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:17.667127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:17.667127 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:17.670632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:17.674533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:17.910166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-946c4d91-4043-404e-b405-56c0d341e56f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.438076 Nov 23 10:26:17.913763 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 571/1150] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:26:16 2021] POST /compute/v2.1/servers => generated 404 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:26:17.927859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f9354a0-d336-42df-b6d4-9c1d86d76333 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:17.929210 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f9354a0-d336-42df-b6d4-9c1d86d76333 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:17.986784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:18.016220 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb49597e-3112-4209-a31a-00a8678552ba tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.396036 Nov 23 10:26:18.016821 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 580/1151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:17 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:18.060087 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8f9354a0-d336-42df-b6d4-9c1d86d76333 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:18.071076 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f9354a0-d336-42df-b6d4-9c1d86d76333 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1094 microversion: 2.1 time: 0.152821 Nov 23 10:26:18.072855 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 572/1152] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:17 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1094 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:19.034758 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:19.036077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:19.045039 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:19.046858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:19.046858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:19.047159 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:19.099878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:19.102136 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:19.119108 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:19.119904 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:19.122967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:19.123677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:19.235681 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:19.244491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-448e96a1-cf79-4c82-b356-85105424c074 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1192 microversion: 2.1 time: 0.149031 Nov 23 10:26:19.245616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 573/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:19 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1192 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:19.294316 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:19.305582 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1f102fd-2927-4c7f-bd75-994e209373e5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1361 microversion: 2.1 time: 0.275661 Nov 23 10:26:19.306388 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 581/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:19 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:20.267975 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:20.269066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:20.280687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.281468 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:20.283504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.284578 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:20.329164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:20.329799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:20.338786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.341341 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:20.342191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.342628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:20.585394 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:20.596230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15ca19c5-dc90-4c7a-bc91-2412ed2db8c5 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.334961 Nov 23 10:26:20.605768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 574/1155] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:20 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:20.711674 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:20.721545 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8333d615-19bb-4c2b-8423-629fd73f3fed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1546 microversion: 2.1 time: 0.396021 Nov 23 10:26:20.722158 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 582/1156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:20 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1546 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:20.741089 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:20.741965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:20.758518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.759440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:20.760566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:20.761931 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:21.060400 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-590813e6-1a94-4745-bebb-1d3e23ea382a req-b5281d74-486d-451b-8679-aa2f0ce5d049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4231d3-1794-4304-8ccc-76b478815c0f", "tag": "1a183294-3274-4e15-84b2-7ee32f87908f"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:21.062091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:21.062091 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:26:21.071043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-590813e6-1a94-4745-bebb-1d3e23ea382a req-b5281d74-486d-451b-8679-aa2f0ce5d049 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:21.071520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-590813e6-1a94-4745-bebb-1d3e23ea382a req-b5281d74-486d-451b-8679-aa2f0ce5d049 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:21.083799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-590813e6-1a94-4745-bebb-1d3e23ea382a req-b5281d74-486d-451b-8679-aa2f0ce5d049 service nova] Creating event network-changed:1a183294-3274-4e15-84b2-7ee32f87908f for instance ca4231d3-1794-4304-8ccc-76b478815c0f on hv-cinder-80403 Nov 23 10:26:21.089789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-590813e6-1a94-4745-bebb-1d3e23ea382a req-b5281d74-486d-451b-8679-aa2f0ce5d049 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037000 Nov 23 10:26:21.091130 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 583/1157] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:26:21.154762 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d227907f-7f8b-4373-9b8b-1998711dd454 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.419486 Nov 23 10:26:21.156019 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 575/1158] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Nov 23 10:26:20 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-interface => generated 284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:26:21.615010 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:21.616519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:21.629725 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:21.630286 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:21.631165 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:21.631696 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:21.978496 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:21.987383 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-466ba238-4405-4994-8087-770c9bba0e9e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.377481 Nov 23 10:26:21.987982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 584/1159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:21 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:22.737670 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-7e2e40b2-699f-4ea2-9168-ea0c7da35efa req-01b31b4f-69ee-46a0-8fa5-d1d6128c73b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6ee0e-0a95-48b7-8b0d-50548e0bc60e", "tag": "e8e96bbd-a37b-4696-abfe-810dc94c8893"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:22.738482 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:22.739548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:22.739548 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:26:22.740082 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:22.748858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-7e2e40b2-699f-4ea2-9168-ea0c7da35efa req-01b31b4f-69ee-46a0-8fa5-d1d6128c73b7 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:22.749682 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-7e2e40b2-699f-4ea2-9168-ea0c7da35efa req-01b31b4f-69ee-46a0-8fa5-d1d6128c73b7 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:22.761663 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:22.762115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-7e2e40b2-699f-4ea2-9168-ea0c7da35efa req-01b31b4f-69ee-46a0-8fa5-d1d6128c73b7 service nova] Creating event network-changed:e8e96bbd-a37b-4696-abfe-810dc94c8893 for instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e on hv-cinder-80403 Nov 23 10:26:22.762480 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:22.767690 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-7e2e40b2-699f-4ea2-9168-ea0c7da35efa req-01b31b4f-69ee-46a0-8fa5-d1d6128c73b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033521 Nov 23 10:26:22.768895 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 585/1160] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:26:22.769673 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:22.770453 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:22.847988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62be2fdd-eebf-410c-805f-cb50f4675e11 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.116346 Nov 23 10:26:22.850458 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 576/1161] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:22 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:23.006866 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:23.007816 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:23.014253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:23.014965 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:23.015990 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:23.016603 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:23.236877 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:23.246591 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a90bcc3-f3f2-4755-be02-4796f446f0d3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.243889 Nov 23 10:26:23.261724 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 586/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:23 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:23.863419 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:23.864413 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:23.872730 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:23.873165 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:23.873991 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:23.874745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:23.950593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6bc0af4-a822-41ca-ac31-92cd9bf92a16 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.091079 Nov 23 10:26:23.951159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 577/1163] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:23 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:24.274294 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:24.274964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:24.283305 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:24.285969 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:24.287112 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:24.287751 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:24.445493 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:24.453334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98e7f567-6189-41a9-acda-c2644b547c76 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.184413 Nov 23 10:26:24.453945 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 587/1164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:24 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:24.961496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:24.962539 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:24.973411 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:24.973950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:24.974758 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:24.975195 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:25.038302 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d832973-a33d-4486-a539-c56183aaf570 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.080437 Nov 23 10:26:25.039173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 578/1165] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:24 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:25.470324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:25.470954 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:25.478051 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:25.479195 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:25.480330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:25.480330 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:25.646795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:25.655135 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d10f49d7-c7a9-4921-af32-9cf56831146e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.188736 Nov 23 10:26:25.655784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 588/1166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:25 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:26.049493 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:26.050446 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:26.057914 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:26.058367 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:26.059174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:26.059611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:26.126782 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99a8d3ba-4132-4448-9157-90340b866eb5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.081126 Nov 23 10:26:26.127648 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 579/1167] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:26 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:26.672758 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:26.673318 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:26.679899 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:26.680352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:26.681323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:26.682001 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:26.822519 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:26.830596 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51e4f2d7-a187-452d-8f6b-1083418ecd62 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.161928 Nov 23 10:26:26.831178 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 589/1168] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:26 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:27.139532 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:27.140605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:27.147504 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:27.147953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:27.148732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:27.149161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:27.212149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aee0d218-efd6-4a30-abd6-4211f909cbd0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.076899 Nov 23 10:26:27.212812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 580/1169] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:27 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:27.851237 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:27.852342 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:27.862734 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:27.863313 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:27.864526 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:27.865067 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:28.099516 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:28.108346 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21dde0a9-7a51-47a9-ab55-699f698e2bba tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.263689 Nov 23 10:26:28.108938 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 590/1170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:27 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:28.225988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:28.227501 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:28.235027 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:28.235473 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:28.236288 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:28.236865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:28.312868 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9330b05f-e616-423c-9fba-42f66bac9154 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.092717 Nov 23 10:26:28.313508 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 581/1171] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:28 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:29.144462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:29.145633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:29.158694 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:29.159529 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:29.160982 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:29.161825 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:29.326667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:29.327667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:29.349629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:29.350889 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:29.353079 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:29.354294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:29.402827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:29.412688 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51b83c7a-c4ac-49f8-94e0-d3aacad349c4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.281385 Nov 23 10:26:29.420901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 591/1172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:29 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:29.451395 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1404d09-b124-4aa8-bbb3-4c6d3894b3c3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.129191 Nov 23 10:26:29.452187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 582/1173] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:29 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:26:30.438212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:30.439191 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:30.449635 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:30.450389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:30.451681 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:30.452501 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:30.470054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:30.471684 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:30.482783 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:30.483507 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:30.485016 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:30.485520 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:30.577907 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-50a57979-bbba-4371-9317-37f2a2078514 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14 microversion: 2.1 time: 0.114964 Nov 23 10:26:30.579614 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 583/1174] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:30 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:26:30.680521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:30.690323 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e5a83c7-7bb4-4acd-b1d2-30cfa930366a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.256915 Nov 23 10:26:30.690907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 592/1175] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:30 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:31.128687 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5fb69fda-6406-418e-93bd-f6891215b0eb req-767c8d00-6064-41cb-b944-34a67c45ca53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4231d3-1794-4304-8ccc-76b478815c0f", "name": "network-vif-plugged", "status": "completed", "tag": "1a183294-3274-4e15-84b2-7ee32f87908f"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:31.130742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:31.130742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:26:31.140950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5fb69fda-6406-418e-93bd-f6891215b0eb req-767c8d00-6064-41cb-b944-34a67c45ca53 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:31.141396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5fb69fda-6406-418e-93bd-f6891215b0eb req-767c8d00-6064-41cb-b944-34a67c45ca53 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:31.154359 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5fb69fda-6406-418e-93bd-f6891215b0eb req-767c8d00-6064-41cb-b944-34a67c45ca53 service nova] Creating event network-vif-plugged:1a183294-3274-4e15-84b2-7ee32f87908f for instance ca4231d3-1794-4304-8ccc-76b478815c0f on hv-cinder-80403 Nov 23 10:26:31.159906 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5fb69fda-6406-418e-93bd-f6891215b0eb req-767c8d00-6064-41cb-b944-34a67c45ca53 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035459 Nov 23 10:26:31.161008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 584/1176] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:26:31.593686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:31.595363 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:31.602439 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:31.602892 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:31.603678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:31.604717 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:31.709187 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:31.710563 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:31.719388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:31.720172 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:31.721260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:31.722047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:31.735290 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5895136-e0ff-451d-bbb8-d47b593352f5 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 6451 microversion: 2.1 time: 0.148311 Nov 23 10:26:31.735954 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 593/1177] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:31 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 6451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:31.925719 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:31.936585 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b8c3266-401a-4b00-80b0-ac5dfbb7b2ad tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1264 microversion: 2.1 time: 0.232298 Nov 23 10:26:31.937159 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 585/1178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:31 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:32.748655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:32.749653 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:32.756802 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:32.757244 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:32.758180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:32.758649 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:32.852941 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-194be9e6-d780-45ff-9640-611daf04f09e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 14047 microversion: 2.1 time: 0.108178 Nov 23 10:26:32.853600 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 594/1179] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:32 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 14047 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:32.956102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:32.956806 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:32.963859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:32.964312 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:32.965147 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:32.965588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:33.100190 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:33.107616 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44c761b8-3861-4e2d-8c3e-c35527036cfb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1452 microversion: 2.1 time: 0.155157 Nov 23 10:26:33.108173 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 586/1180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:32 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:26:33.124777 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:26:33.125475 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:33.132862 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:33.133359 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:33.134217 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:33.134655 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:33.282469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:26:33.290126 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b81e325a-5928-4ed1-90d1-e6bfef1ceada tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1452 microversion: 2.1 time: 0.169257 Nov 23 10:26:33.290703 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 595/1181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:26:33 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:26:33.868582 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:33.871152 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:33.881613 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:33.882381 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:33.883696 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:33.884714 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:33.981183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-12b8c398-d047-4584-9dd4-aae34666727f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 18305 microversion: 2.1 time: 0.118975 Nov 23 10:26:33.983003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 587/1182] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:33 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 18305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:34.996616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:34.998376 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:35.006247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:35.006698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:35.007528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:35.007974 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:35.083492 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6a4332d-a132-406e-baa9-ea3dff7c9faa tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 19342 microversion: 2.1 time: 0.091974 Nov 23 10:26:35.084146 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 596/1183] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:34 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 19342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:35.395114 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a070b6e2-58b7-4f45-8822-2850212a164f req-4d021373-687d-4139-9694-bf70c1aa29f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4231d3-1794-4304-8ccc-76b478815c0f", "tag": "1a183294-3274-4e15-84b2-7ee32f87908f"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:35.398672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:26:35.398672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:26:35.413248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a070b6e2-58b7-4f45-8822-2850212a164f req-4d021373-687d-4139-9694-bf70c1aa29f8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:35.414031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a070b6e2-58b7-4f45-8822-2850212a164f req-4d021373-687d-4139-9694-bf70c1aa29f8 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:35.439031 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a070b6e2-58b7-4f45-8822-2850212a164f req-4d021373-687d-4139-9694-bf70c1aa29f8 service nova] Creating event network-changed:1a183294-3274-4e15-84b2-7ee32f87908f for instance ca4231d3-1794-4304-8ccc-76b478815c0f on hv-cinder-80403 Nov 23 10:26:35.447744 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a070b6e2-58b7-4f45-8822-2850212a164f req-4d021373-687d-4139-9694-bf70c1aa29f8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059663 Nov 23 10:26:35.448957 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 588/1184] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:26:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:26:36.096744 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:36.097957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:36.105077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:36.105957 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:36.106995 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:36.107639 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:36.189463 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2242d014-bedf-46d7-9bf8-4a4441461058 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 21966 microversion: 2.1 time: 0.096067 Nov 23 10:26:36.191068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 597/1185] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:36 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 21966 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:37.203040 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:37.204153 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:37.212400 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:37.213020 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:37.214870 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:37.215594 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:37.319794 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0033dfa-4213-4ffd-88d8-fb5b3dbb47ed tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 23222 microversion: 2.1 time: 0.121595 Nov 23 10:26:37.320768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 589/1186] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:37 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 23222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:38.333817 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:38.334826 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:38.342180 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:38.342632 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:38.343427 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:38.343858 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:38.422083 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f1e92cee-f894-4cf8-b593-13b18a5f4449 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 23919 microversion: 2.1 time: 0.091984 Nov 23 10:26:38.422752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 598/1187] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:38 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 23919 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:39.435449 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:39.436362 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:39.443462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:39.443918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:39.444743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:39.445181 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:39.528060 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e330b6a5-8ebc-4f72-a0d2-3967860b95cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 25421 microversion: 2.1 time: 0.097194 Nov 23 10:26:39.528706 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 590/1188] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:39 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 25421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:40.543768 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:40.544707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:40.555842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:40.555842 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:40.557735 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:40.559147 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:40.651426 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3f5c60d-007c-4e3a-9840-7ad459c1d501 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 26711 microversion: 2.1 time: 0.111114 Nov 23 10:26:40.655588 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 599/1189] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:40 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 26711 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:41.663893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:41.664804 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:41.671853 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:41.672301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:41.673088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:41.673518 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:41.759644 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6b49594f-67ef-4c00-823f-8107ab209f5a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 27519 microversion: 2.1 time: 0.099473 Nov 23 10:26:41.761242 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 591/1190] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:41 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 27519 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:42.772775 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:42.774115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:42.782073 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:42.782510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:42.783296 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:42.783726 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:42.875038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4e89b8ee-b99c-4f74-a1cb-1aa17783e601 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 27788 microversion: 2.1 time: 0.105993 Nov 23 10:26:42.875610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 600/1191] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:42 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 27788 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:43.889298 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:43.890218 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:43.897448 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:43.897936 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:43.898893 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:43.899397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:43.979842 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eaaa87e1-caad-4cbc-b763-aa7adb13468e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28193 microversion: 2.1 time: 0.094545 Nov 23 10:26:43.980494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 592/1192] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:43 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:44.998134 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:44.999212 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:45.006352 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:45.006791 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:45.007618 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:45.008004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:45.079481 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88ae83cc-2099-49a2-bba0-ed67789e0bc3 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28193 microversion: 2.1 time: 0.088787 Nov 23 10:26:45.080216 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 601/1193] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:44 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:46.094374 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:46.095978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:46.105876 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:46.106649 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:46.108307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:46.108748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:46.200917 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26904d96-050b-47d4-ac98-ef58cca5a4df tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28193 microversion: 2.1 time: 0.111114 Nov 23 10:26:46.201565 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 593/1194] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:46 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:47.215433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:47.217445 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:47.225872 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:47.226321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:47.227118 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:47.227641 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:47.312553 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c36a15d-5ca7-4c87-a505-d34f9b8849c7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28484 microversion: 2.1 time: 0.102973 Nov 23 10:26:47.313883 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 602/1195] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:47 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28484 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:48.328049 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:48.328965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:48.336949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:48.337409 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:48.338950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:48.339498 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:48.428029 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b79564b7-7dfa-4e0e-abfa-2227d4a28787 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28580 microversion: 2.1 time: 0.104601 Nov 23 10:26:48.428675 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 594/1196] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:48 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28580 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:49.440477 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:49.441484 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:49.450060 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:49.450514 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:49.451310 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:49.451749 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:49.544996 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7297c4c0-aa9e-4d4a-8d06-1a1fb3fa25e2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28651 microversion: 2.1 time: 0.108243 Nov 23 10:26:49.545572 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 603/1197] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:49 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28651 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:50.557470 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:50.558408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:50.565380 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:50.565863 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:50.566652 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:50.567091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:50.638313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d65720c2-79cc-4428-9ba5-7f766492df58 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28651 microversion: 2.1 time: 0.085494 Nov 23 10:26:50.640657 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 595/1198] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:50 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28651 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:51.652021 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:51.652917 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:51.660658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:51.662104 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:51.663215 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:51.663658 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:51.752361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11b07cfc-d2aa-46f0-a0ba-c40ccddc4c1e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28651 microversion: 2.1 time: 0.104020 Nov 23 10:26:51.753462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 604/1199] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:51 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28651 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:52.766990 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:52.768092 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:52.775871 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:52.776348 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:52.777139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:52.777602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:52.845733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-09a45df1-c1f4-482c-9ee8-0f0f749aadbf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 28651 microversion: 2.1 time: 0.082709 Nov 23 10:26:52.846389 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 596/1200] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:52 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 28651 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:26:53.860795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:53.862326 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:53.870157 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:53.870599 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:53.871381 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:53.871811 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:54.121867 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34328ed2-b02f-464b-8df3-78377977b09c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 29417 microversion: 2.1 time: 0.264937 Nov 23 10:26:54.122849 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 605/1201] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:53 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 29417 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:55.135002 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:55.136021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:55.143524 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:55.143971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:55.144761 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:55.145230 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:55.233095 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d801a81-d59b-48bb-9bf6-173b37f75562 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 31047 microversion: 2.1 time: 0.102783 Nov 23 10:26:55.233790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 597/1202] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:55 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 31047 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:56.245121 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:56.246158 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:56.253284 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:56.253755 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:56.254747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:56.255183 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:56.344433 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54b1c01a-365c-463b-9a1d-f82016b5932b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 32289 microversion: 2.1 time: 0.103405 Nov 23 10:26:56.344993 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 606/1203] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:56 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 32289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:57.356859 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:57.357925 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:57.365545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:57.366027 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:57.366830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:57.367327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:57.482107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c94b569d-1f33-409b-a10d-dc01437a673f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 33256 microversion: 2.1 time: 0.129721 Nov 23 10:26:57.482751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 598/1204] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:57 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 33256 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:58.495690 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:58.496936 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:58.504533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:58.505032 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:58.506061 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:58.506566 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:58.596077 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c117c63b-4f5c-4959-bb54-12121535247b tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 33764 microversion: 2.1 time: 0.104909 Nov 23 10:26:58.596605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 607/1205] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:58 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 33764 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:26:59.612701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:26:59.614044 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:26:59.623253 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:59.623701 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:59.624496 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:26:59.624929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:26:59.718802 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ef2b894d-9bd7-4f00-9621-9fd9b08b505e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 34649 microversion: 2.1 time: 0.113269 Nov 23 10:26:59.719800 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 599/1206] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:26:59 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 34649 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:27:00.738100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:00.739351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:00.747693 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:00.748139 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:00.749125 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:00.749561 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:00.840440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-19976045-901b-41bc-adf2-afe995d8c38f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 35769 microversion: 2.1 time: 0.110380 Nov 23 10:27:00.841098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 608/1207] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:27:00 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 35769 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:27:01.853901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:01.854901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:01.861953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:01.862404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:01.863224 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:01.863658 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:01.954274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6eb87eb9-7dc9-4952-8013-067318494c89 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 37166 microversion: 2.1 time: 0.104886 Nov 23 10:27:01.955183 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 600/1208] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:27:01 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 37166 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:27:02.966997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:02.968003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:02.975078 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:02.975528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:02.976311 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:02.976747 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:05.353096 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fdd5d59-fcbd-413c-9b66-06119b4a4085 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 38175 microversion: 2.1 time: 2.389548 Nov 23 10:27:05.354151 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 609/1209] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:27:02 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 38175 bytes in 2392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:27:06.370487 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:06.371793 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:06.379110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:06.379568 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:06.380354 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:06.380789 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:06.467071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99df74e5-a7cd-4d9b-a72b-9bec603ae097 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 38182 microversion: 2.1 time: 0.104698 Nov 23 10:27:06.468287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 601/1210] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:27:06 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 38182 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 10:27:07.480616 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:07.481644 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:07.489502 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:07.489972 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:07.490750 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:07.491208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:07.579308 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5668e91d-8126-4329-8caf-ba8d34f22e8e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action" status: 200 len: 38302 microversion: 2.1 time: 0.103123 Nov 23 10:27:07.579907 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 610/1211] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Nov 23 10:27:07 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/action => generated 38302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 10:27:07.598339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:07.599884 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:07.609735 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:07.610476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:07.612062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:07.612812 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:07.639024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b01229d6-0f18-4d9a-ba91-9a10c4930cf7 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/ips" status: 200 len: 145 microversion: 2.1 time: 0.047722 Nov 23 10:27:07.639599 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 602/1212] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Nov 23 10:27:07 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:09.051993 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c585c895-5448-4b5a-9ec4-489eb6bbc293"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:09.053259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:09.063103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:09.063832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:09.064851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:09.065377 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:09.363651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69b19b98-be12-42ce-8441-c0489885dccf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317475 Nov 23 10:27:09.364152 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 611/1213] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:27:09 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:17.168301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:17.169228 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:17.176294 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:17.176734 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:17.177490 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:17.177956 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:17.209000 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d7d0f01e-132d-4d2a-b9a6-3d1fa886dc88 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Nov 23 10:27:17.209602 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 603/1214] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:27:17 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:17.221181 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:17.221836 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:17.228722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:17.229166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:17.229970 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:17.230404 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:17.261219 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec9d8384-6ba7-44b9-907f-68e3dab493cc tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293" status: 200 len: 194 microversion: 2.1 time: 0.044737 Nov 23 10:27:17.261820 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 612/1215] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Nov 23 10:27:17 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:27:18.616694 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "755ebdbe-a797-4fc3-8d24-0b7358f0cad7"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:18.617993 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:18.623824 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:18.624272 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:18.625054 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:18.625484 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:18.890149 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-531419e5-f200-48bb-9585-a5bc4f39ade2 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277137 Nov 23 10:27:18.890968 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 604/1216] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Nov 23 10:27:18 2021] POST /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:26.429489 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:26.430597 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:26.437549 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.438054 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.438885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.439336 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.474954 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4abe2d77-2217-4eb4-bf54-9e5f8ccf0239 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049255 Nov 23 10:27:26.475528 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 613/1217] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:27:26 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:26.753256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:26.754274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:26.762667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.763248 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.764071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.764502 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.798281 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38e0cac7-ad36-44ad-b233-b1b2a2585348 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293" status: 200 len: 194 microversion: 2.1 time: 0.052649 Nov 23 10:27:26.798901 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 605/1218] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Nov 23 10:27:26 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:26.809480 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:26.810023 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:26.816651 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.817115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.817985 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:26.818424 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:26.910815 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lazy-loading 'services' on Instance uuid 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:27:26.987229 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ac8d527-86f9-45d9-be34-055656a4ad98 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293" status: 202 len: 0 microversion: 2.1 time: 0.181896 Nov 23 10:27:26.988122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 614/1219] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:27:26 2021] DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/c585c895-5448-4b5a-9ec4-489eb6bbc293 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:27:28.116392 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:28.116905 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:28.123151 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:28.123588 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:28.124350 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:28.124779 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:28.153569 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a652999-6831-4416-b0cf-8de95f402db0 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/755ebdbe-a797-4fc3-8d24-0b7358f0cad7" status: 200 len: 194 microversion: 2.1 time: 0.040840 Nov 23 10:27:28.154172 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 606/1220] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Nov 23 10:27:28 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/755ebdbe-a797-4fc3-8d24-0b7358f0cad7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:28.164344 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:28.164916 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:28.171362 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:28.171807 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:28.172575 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:28.173007 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:28.251737 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lazy-loading 'services' on Instance uuid 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 10:27:28.321276 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69292e92-7dee-4f5b-af32-57ed963d2eaf tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/755ebdbe-a797-4fc3-8d24-0b7358f0cad7" status: 202 len: 0 microversion: 2.1 time: 0.160767 Nov 23 10:27:28.322576 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 615/1221] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Nov 23 10:27:28 2021] DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments/755ebdbe-a797-4fc3-8d24-0b7358f0cad7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:27:29.472354 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:29.473321 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:29.479611 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.480057 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.480830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.481263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.508732 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b95af023-ec7c-4e8f-b481-265228dab2b8 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040208 Nov 23 10:27:29.509860 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 607/1222] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:27:29 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 10:27:29.615792 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:29.616787 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:29.622913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.623360 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.624133 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.624567 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.654289 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83d5ae82-0bab-4a12-8e94-e6bc9db9ac63 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043034 Nov 23 10:27:29.654852 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 616/1223] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Nov 23 10:27:29 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 10:27:29.711637 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:29.712136 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:29.718959 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.719408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.720182 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.720622 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.745155 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:27:29.823154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1bd4c1d7-1f07-49ad-9e61-f20394aeccce tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 204 len: 0 microversion: 2.1 time: 0.114003 Nov 23 10:27:29.824027 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 608/1224] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:27:29 2021] DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:27:29.832939 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:29.833551 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:29.840288 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.840727 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.841499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:29.841958 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:29.979272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:27:29.986901 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11accda1-cb62-4172-9b32-0fdfcfdd852c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1671 microversion: 2.1 time: 0.158419 Nov 23 10:27:29.987510 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 617/1225] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:29 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:27:31.004790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:31.005483 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:31.011865 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:31.012307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:31.013075 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:31.013506 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:31.144729 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:27:31.152593 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a564bad-60f0-4bc9-81f3-b0b98743bd6a tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1671 microversion: 2.1 time: 0.151874 Nov 23 10:27:31.153168 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 609/1226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:30 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:27:32.170033 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:32.170627 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:32.177000 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:32.177447 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:32.178250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:32.178684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:32.325462 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d5366809434d0bbeae12b0ddb9f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e6bc65e4594796a6958f6e1d36295c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:27:32.333036 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b77ba2a3-2e12-439d-bfe9-f8e9c5291302 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 200 len: 1671 microversion: 2.1 time: 0.166639 Nov 23 10:27:32.333625 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 618/1227] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:32 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:27:32.630170 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-58923e9b-99e9-4460-9770-32934c64ae6a req-1d6cbff9-2400-453a-9495-afab163c1599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6ee0e-0a95-48b7-8b0d-50548e0bc60e", "name": "network-vif-deleted", "tag": "e8e96bbd-a37b-4696-abfe-810dc94c8893"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:27:32.631938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:27:32.631938 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:27:32.640319 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-58923e9b-99e9-4460-9770-32934c64ae6a req-1d6cbff9-2400-453a-9495-afab163c1599 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:32.641062 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-58923e9b-99e9-4460-9770-32934c64ae6a req-1d6cbff9-2400-453a-9495-afab163c1599 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:32.653397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-58923e9b-99e9-4460-9770-32934c64ae6a req-1d6cbff9-2400-453a-9495-afab163c1599 service nova] Creating event network-vif-deleted:e8e96bbd-a37b-4696-abfe-810dc94c8893 for instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e on hv-cinder-80403 Nov 23 10:27:32.658971 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-58923e9b-99e9-4460-9770-32934c64ae6a req-1d6cbff9-2400-453a-9495-afab163c1599 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032658 Nov 23 10:27:32.659562 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 610/1228] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:27:33.349940 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:33.350636 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:33.357124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:33.357656 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:33.358531 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:33.359043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:33.372707 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. Nov 23 10:27:33.373333 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:27:33.374176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6ff84a8f-331f-47d3-8886-a1f9c890d58f tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 404 len: 111 microversion: 2.1 time: 0.028135 Nov 23 10:27:33.374741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 619/1229] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:33 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:27:33.383459 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-81b4fb00-4297-43aa-a959-1cd5ea43e755 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '.version_select at 0x7f9fe05985e0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:33.404600 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-81b4fb00-4297-43aa-a959-1cd5ea43e755 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771018647" status: 202 len: 0 microversion: 2.1 time: 0.025163 Nov 23 10:27:33.408547 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 611/1230] 10.222.0.41 () {58 vars in 1220 bytes} [Tue Nov 23 10:27:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771018647 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 10:27:36.309772 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:36.310251 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:36.316673 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:36.317115 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:36.317903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:36.318334 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:36.332043 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. Nov 23 10:27:36.332620 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:27:36.333471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c40f2982-69ef-4973-9036-81b7dbc1ac3c tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 404 len: 111 microversion: 2.1 time: 0.028071 Nov 23 10:27:36.334189 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 620/1231] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:27:36 2021] DELETE /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:27:36.342102 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:36.342830 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:36.348758 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:36.349201 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:36.350015 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:36.350478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:36.363760 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. Nov 23 10:27:36.364337 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 3de6ee0e-0a95-48b7-8b0d-50548e0bc60e could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:27:36.365138 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f142ef53-6c07-4cdd-b665-a1f136a8aa3e tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e" status: 404 len: 111 microversion: 2.1 time: 0.027287 Nov 23 10:27:36.365659 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 612/1232] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:36 2021] GET /compute/v2.1/servers/3de6ee0e-0a95-48b7-8b0d-50548e0bc60e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:27:37.492199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:37.492698 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:37.499411 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:37.499860 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:37.500628 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:37.501063 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:37.514821 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. Nov 23 10:27:37.515408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:27:37.516236 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7d11cb9-0c7b-46e0-a1e8-647df83fe2e6 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 404 len: 111 microversion: 2.1 time: 0.027710 Nov 23 10:27:37.516784 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 621/1233] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:27:37 2021] DELETE /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:27:37.524672 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:27:37.525282 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] [instance: 7057a553-2d1e-42cd-871a-a866b56242da] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:27:37.532006 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:37.532456 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:37.533252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:27:37.533709 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:27:37.547046 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] HTTP exception thrown: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. Nov 23 10:27:37.547566 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] Returning 404 to user: Instance 7057a553-2d1e-42cd-871a-a866b56242da could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:27:37.548408 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-86401b6b-32a8-48d3-84fe-123c02f187d4 tempest-AttachVolumeTestJSON-1984173079 tempest-AttachVolumeTestJSON-1984173079-project] 10.222.0.41 "GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da" status: 404 len: 111 microversion: 2.1 time: 0.027437 Nov 23 10:27:37.548927 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 613/1234] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:27:37 2021] GET /compute/v2.1/servers/7057a553-2d1e-42cd-871a-a866b56242da => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:27:51.854994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:27:51.855801 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:27:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:28:06.880084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:28:06.880795 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:28:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:28:55.634390 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:28:55.635047 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:28:55.640752 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:55.641202 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:55.642009 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:55.642441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:55.667680 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:28:55.749536 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4fd2ba72-a6f2-416d-bc32-77977ff5f446 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 204 len: 0 microversion: 2.1 time: 0.120911 Nov 23 10:28:55.750166 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 622/1235] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:28:55 2021] DELETE /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:28:55.762390 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:28:55.763008 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:28:55.769856 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:55.770339 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:55.771118 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:55.771546 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:56.096293 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:28:56.104261 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0610425-f92d-4fa3-be35-4a5d6cd9ec80 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1577 microversion: 2.1 time: 0.349190 Nov 23 10:28:56.104820 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 614/1236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:28:55 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1577 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:28:57.122583 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:28:57.123281 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:28:57.130832 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:57.131277 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:57.132059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:57.132500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:57.329799 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:28:57.337930 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78cc653c-44e0-48a8-86f0-e451a6f061c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1577 microversion: 2.1 time: 0.219371 Nov 23 10:28:57.338499 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 623/1237] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:28:57 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:28:58.357528 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:28:58.358438 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:28:58.368926 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:58.369373 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:58.370396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:58.370845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:58.439689 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:28:58.448233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-019a1126-e10c-40d1-946d-6cf13b51da84 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 200 len: 1511 microversion: 2.1 time: 0.096516 Nov 23 10:28:58.448837 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 615/1238] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:28:58 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:28:58.590794 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-4baa76b5-c1e1-49f4-9983-45585a4eed0d req-350d5d93-a236-45ec-9b27-c4465677a100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4231d3-1794-4304-8ccc-76b478815c0f", "name": "network-vif-deleted", "tag": "1a183294-3274-4e15-84b2-7ee32f87908f"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:28:58.593713 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:28:58.593713 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:28:58.603124 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4baa76b5-c1e1-49f4-9983-45585a4eed0d req-350d5d93-a236-45ec-9b27-c4465677a100 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:58.603903 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4baa76b5-c1e1-49f4-9983-45585a4eed0d req-350d5d93-a236-45ec-9b27-c4465677a100 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:58.616964 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-4baa76b5-c1e1-49f4-9983-45585a4eed0d req-350d5d93-a236-45ec-9b27-c4465677a100 service nova] Creating event network-vif-deleted:1a183294-3274-4e15-84b2-7ee32f87908f for instance ca4231d3-1794-4304-8ccc-76b478815c0f on hv-cinder-80403 Nov 23 10:28:58.622434 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-4baa76b5-c1e1-49f4-9983-45585a4eed0d req-350d5d93-a236-45ec-9b27-c4465677a100 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108610 Nov 23 10:28:58.623048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 624/1239] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:28:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:28:59.470048 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:28:59.470743 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:28:59.480166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:59.480166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:59.480166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:28:59.480166 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:28:59.498096 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] HTTP exception thrown: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. Nov 23 10:28:59.498705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Returning 404 to user: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:28:59.499540 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-973bffff-06aa-4580-8640-19e8b13f71e4 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 404 len: 111 microversion: 2.1 time: 0.033915 Nov 23 10:28:59.500107 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 616/1240] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:28:59 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 10:28:59.629955 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-274817460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-279048301", "security_groups": [{"name": "tempest-secgroup-smoke-20173602"}], "block_device_mapping_v2": [{"uuid": "1273e36c-1f34-434c-8a02-017671ee988f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31033c80-6f35-48ab-a7f7-d83be34974ec"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:28:59.752001 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] validate_networks() for [('31033c80-6f35-48ab-a7f7-d83be34974ec', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:29:00.206819 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:29:00.207242 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:29:00.207711 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:29:00.208116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:29:00.208521 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:29:00.217101 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:00.217520 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:00.218351 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:00.218779 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:00.235488 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:29:00.241325 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for user 503a487ef2034c848bf728d634073470 and project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:29:00.306976 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:29:00.309468 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1273e36c-1f34-434c-8a02-017671ee988f',volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:29:00.444375 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb8af40e-6fee-4529-86b9-ec4c2af61ddc tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.819170 Nov 23 10:29:00.445014 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 625/1241] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:28:59 2021] POST /compute/v2.1/servers => generated 404 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:29:00.455088 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-477f0ded-61a6-4f87-8e2d-a2caa79ea8ce tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:00.455705 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-477f0ded-61a6-4f87-8e2d-a2caa79ea8ce tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:00.515801 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-477f0ded-61a6-4f87-8e2d-a2caa79ea8ce tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:00.523551 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-477f0ded-61a6-4f87-8e2d-a2caa79ea8ce tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1093 microversion: 2.1 time: 0.072231 Nov 23 10:29:00.524575 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 617/1242] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:00 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:01.544270 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:01.544920 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:01.552474 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:01.553098 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:01.553686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:01.556355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:01.621606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:01.630208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22c763da-fa2c-4861-85f9-008096fcf249 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1191 microversion: 2.1 time: 0.089970 Nov 23 10:29:01.630793 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 626/1243] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:01 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:02.648464 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:02.649174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:02.657899 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:02.658629 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:02.659742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:02.661949 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:03.162194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:03.172197 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6711605e-695e-4e93-95bd-fc098c838b27 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.528059 Nov 23 10:29:03.173106 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 618/1244] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:02 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:29:03.516851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-3dfb8b43-2f9f-453a-b294-123583df288f req-8c6417f8-3046-4f62-8624-a3589faf3449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723738a5-b749-4d60-b025-d5afb7e6df8a", "tag": "9a9144fd-1d47-480f-8c17-62ee6f71529b"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:29:03.520205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:29:03.520205 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:29:03.535706 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3dfb8b43-2f9f-453a-b294-123583df288f req-8c6417f8-3046-4f62-8624-a3589faf3449 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:03.536471 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3dfb8b43-2f9f-453a-b294-123583df288f req-8c6417f8-3046-4f62-8624-a3589faf3449 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:03.558913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-3dfb8b43-2f9f-453a-b294-123583df288f req-8c6417f8-3046-4f62-8624-a3589faf3449 service nova] Creating event network-changed:9a9144fd-1d47-480f-8c17-62ee6f71529b for instance 723738a5-b749-4d60-b025-d5afb7e6df8a on hv-cinder-80403 Nov 23 10:29:03.564261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-3dfb8b43-2f9f-453a-b294-123583df288f req-8c6417f8-3046-4f62-8624-a3589faf3449 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051619 Nov 23 10:29:03.565196 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 627/1245] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:29:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:29:04.194476 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:04.195414 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:04.202461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:04.202995 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:04.203980 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:04.205113 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:04.432685 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:04.440017 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ee05e6b8-1166-4103-bc20-a1d64ba3e8f3 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.249839 Nov 23 10:29:04.441296 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 619/1246] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:04 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:29:05.459201 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:05.459913 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:05.466164 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:05.466685 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:05.467406 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:05.467929 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:05.609100 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:05.616678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c9e12e8-43f5-4faf-bddc-590574c98a8a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.162786 Nov 23 10:29:05.617245 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 628/1247] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:05 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:06.633356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:06.633984 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:06.640189 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:06.640634 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:06.641513 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:06.641976 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:06.779396 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:06.787313 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1447cc05-2cd3-45fa-a358-a01c6a60a00a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.157714 Nov 23 10:29:06.787878 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 620/1248] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:06 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:07.804745 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:07.806005 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:07.812422 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:07.812865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:07.813661 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:07.814122 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:08.040116 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:08.049933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef5c7b0c-9e15-484f-82ac-8d838ae61728 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.249223 Nov 23 10:29:08.050789 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 629/1249] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:07 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:09.068606 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:09.069427 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:09.075605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:09.076050 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:09.076844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:09.077275 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:09.217418 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:09.225489 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-084e08e2-57f5-43e2-a0ec-9d811b73cc9d tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.161324 Nov 23 10:29:09.226105 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 621/1250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:09 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:10.243393 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:10.244684 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:10.251556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:10.251997 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:10.252786 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:10.253225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:10.391103 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:10.399458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1aa19770-ed1d-4f61-af02-e4a15915de92 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.159650 Nov 23 10:29:10.400090 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 630/1251] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:10 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:11.417751 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:11.418357 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:11.424523 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:11.424964 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:11.425748 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:11.426185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:11.562287 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:11.569967 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ebb6e2db-2850-45dc-83a4-c3b42225d753 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.156276 Nov 23 10:29:11.571223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 622/1252] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:11 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:12.587678 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:12.588261 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:12.594827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:12.595259 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:12.596030 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:12.596456 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:12.762508 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:12.770722 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17209196-83d6-453c-b735-18013e0ec5fd tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.186806 Nov 23 10:29:12.771440 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 631/1253] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:12 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:13.789494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:13.790519 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:13.796679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:13.797121 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:13.797923 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:13.798360 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:13.957731 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:13.965116 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0ddf0df7-677a-409a-ba11-a8087db526ec tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.179386 Nov 23 10:29:13.965712 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 623/1254] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:13 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:29:14.135469 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ee107bf0-83c6-48f8-9d45-a82834d9a3bc req-a122b710-f705-4c20-a8e1-8657e831bcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723738a5-b749-4d60-b025-d5afb7e6df8a", "name": "network-vif-plugged", "status": "completed", "tag": "9a9144fd-1d47-480f-8c17-62ee6f71529b"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:29:14.137111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:29:14.137111 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:29:14.147174 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ee107bf0-83c6-48f8-9d45-a82834d9a3bc req-a122b710-f705-4c20-a8e1-8657e831bcd4 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:14.147953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ee107bf0-83c6-48f8-9d45-a82834d9a3bc req-a122b710-f705-4c20-a8e1-8657e831bcd4 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:14.167428 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ee107bf0-83c6-48f8-9d45-a82834d9a3bc req-a122b710-f705-4c20-a8e1-8657e831bcd4 service nova] Creating event network-vif-plugged:9a9144fd-1d47-480f-8c17-62ee6f71529b for instance 723738a5-b749-4d60-b025-d5afb7e6df8a on hv-cinder-80403 Nov 23 10:29:14.176213 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ee107bf0-83c6-48f8-9d45-a82834d9a3bc req-a122b710-f705-4c20-a8e1-8657e831bcd4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318307 Nov 23 10:29:14.176810 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 632/1255] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:29:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:29:14.983774 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:14.984702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:14.992035 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:14.992481 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:14.993254 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:14.993844 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:15.142301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:15.150636 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d372c89c-6025-4b85-b13d-99fdf6c57c02 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1263 microversion: 2.1 time: 0.171807 Nov 23 10:29:15.151233 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 624/1256] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:14 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:16.169071 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:16.169847 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:16.178500 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:16.178948 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:16.179761 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:16.180193 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:16.314420 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:16.322034 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dcaed9d7-9e17-4f31-a6f6-0dbaf7b95916 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1450 microversion: 2.1 time: 0.157447 Nov 23 10:29:16.322605 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 633/1257] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:16 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:16.341111 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:29:16.341772 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:29:16.348066 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:16.348509 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:16.349929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:16.350369 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:16.489462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:29:16.497402 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2a3a4af-205d-4fe5-9165-5212c665989e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1450 microversion: 2.1 time: 0.161716 Nov 23 10:29:16.498024 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 625/1258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:29:16 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:29:18.602783 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-5eeaef75-9b21-4163-9b1c-4e10456298f0 req-bfaa1a86-c938-4503-9ec6-b570cd62c680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723738a5-b749-4d60-b025-d5afb7e6df8a", "tag": "9a9144fd-1d47-480f-8c17-62ee6f71529b"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:29:18.604729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:29:18.604729 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:29:18.613606 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5eeaef75-9b21-4163-9b1c-4e10456298f0 req-bfaa1a86-c938-4503-9ec6-b570cd62c680 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:29:18.614179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5eeaef75-9b21-4163-9b1c-4e10456298f0 req-bfaa1a86-c938-4503-9ec6-b570cd62c680 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:29:18.627537 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-5eeaef75-9b21-4163-9b1c-4e10456298f0 req-bfaa1a86-c938-4503-9ec6-b570cd62c680 service nova] Creating event network-changed:9a9144fd-1d47-480f-8c17-62ee6f71529b for instance 723738a5-b749-4d60-b025-d5afb7e6df8a on hv-cinder-80403 Nov 23 10:29:18.634203 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-5eeaef75-9b21-4163-9b1c-4e10456298f0 req-bfaa1a86-c938-4503-9ec6-b570cd62c680 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126148 Nov 23 10:29:18.634937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 634/1259] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:29:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:29:30.913215 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:29:30.913941 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: Tue Nov 23 10:29:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:30:56.323286 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867458925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-279048301", "security_groups": [{"name": "tempest-secgroup-smoke-20173602"}], "block_device_mapping_v2": [{"uuid": "4af1d1a1-88b1-4e21-84c0-650cb5b3a4b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31033c80-6f35-48ab-a7f7-d83be34974ec"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:30:56.438047 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] validate_networks() for [('31033c80-6f35-48ab-a7f7-d83be34974ec', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 10:30:56.866466 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 10:30:56.866885 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 10:30:56.867361 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 10:30:56.867767 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 10:30:56.868185 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 10:30:56.877260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:56.877725 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:56.878533 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:56.879004 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:56.896327 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 10:30:56.900460 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Getting quotas for user 503a487ef2034c848bf728d634073470 and project 6d5464f3828b40d9bda83c9806c746b9. Resources: {'ram', 'instances', 'cores'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 10:30:56.958622 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 10:30:56.960839 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4af1d1a1-88b1-4e21-84c0-650cb5b3a4b1',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 10:30:57.101440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-935497a0-b7ec-4c22-bc59-26da8c2c0383 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.782581 Nov 23 10:30:57.102263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 626/1260] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Nov 23 10:30:56 2021] POST /compute/v2.1/servers => generated 404 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 10:30:57.117431 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ca0baa71-a23a-4644-90b7-922b1154b46f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:30:57.118059 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ca0baa71-a23a-4644-90b7-922b1154b46f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:30:57.175943 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ca0baa71-a23a-4644-90b7-922b1154b46f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:30:57.183099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ca0baa71-a23a-4644-90b7-922b1154b46f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1093 microversion: 2.1 time: 0.070925 Nov 23 10:30:57.184099 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 635/1261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:30:57 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:30:58.206093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:30:58.209160 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:30:58.218182 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:58.219161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:58.220133 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:58.220850 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:58.322605 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:30:58.333499 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2f312d4-90dd-4e74-87b2-37a3c5fae692 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1209 microversion: 2.1 time: 0.135297 Nov 23 10:30:58.334440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 627/1262] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:30:58 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:30:59.351664 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:30:59.352282 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:30:59.359924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:59.359924 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:59.360675 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:59.361107 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:59.522886 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:30:59.531978 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30c79f1f-c4d2-44bc-92ea-c8b7bb419b4f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.184111 Nov 23 10:30:59.539621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 636/1263] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:30:59 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:30:59.835430 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b2257e53-b0d8-4def-a200-4b0a128814fa req-a8e398e6-4f73-4f49-b741-4ba162b14d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979672b7-eccf-4cdb-aafe-f47d67e67f6d", "tag": "085d65fc-9807-4a7c-8f2a-67394f36862b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:30:59.838283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:30:59.838283 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:30:59.857434 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b2257e53-b0d8-4def-a200-4b0a128814fa req-a8e398e6-4f73-4f49-b741-4ba162b14d54 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:30:59.858161 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b2257e53-b0d8-4def-a200-4b0a128814fa req-a8e398e6-4f73-4f49-b741-4ba162b14d54 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:30:59.873451 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b2257e53-b0d8-4def-a200-4b0a128814fa req-a8e398e6-4f73-4f49-b741-4ba162b14d54 service nova] Creating event network-changed:085d65fc-9807-4a7c-8f2a-67394f36862b for instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d on hv-cinder-80403 Nov 23 10:30:59.879252 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b2257e53-b0d8-4def-a200-4b0a128814fa req-a8e398e6-4f73-4f49-b741-4ba162b14d54 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050558 Nov 23 10:30:59.881576 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 628/1264] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:31:00.551175 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:00.552558 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:00.561544 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:00.562328 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:00.563700 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:00.564408 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:00.724084 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:00.732321 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e60182f0-9f2b-4a31-9d49-0030b140e61f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.185286 Nov 23 10:31:00.733171 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 637/1265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:00 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:31:01.751273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:01.751988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:01.759234 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:01.759679 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:01.760461 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:01.760895 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:01.912354 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:01.920174 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-82394898-202a-4c6f-a2a7-719f1aba35ca tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.172971 Nov 23 10:31:01.920745 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 629/1266] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:01 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:02.937601 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:02.938230 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:02.944527 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:02.944966 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:02.946851 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:02.947320 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:03.096435 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:03.104797 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cdb3b962-2461-43cf-b099-fd9aebf5a274 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.170827 Nov 23 10:31:03.105410 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 638/1267] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:02 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:04.126545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:04.127775 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:04.138065 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:04.138733 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:04.139667 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:04.140213 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:04.299014 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:04.307897 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ceaaba5d-ee6e-4517-8f6c-ecc51b392a19 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.187255 Nov 23 10:31:04.308492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 630/1268] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:04 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:05.327253 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:05.328154 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:05.335816 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:05.336416 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:05.337443 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:05.338226 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:05.502470 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:05.510587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-227ea7a4-371e-4ef8-930f-9542d2218504 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.187247 Nov 23 10:31:05.511154 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 639/1269] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:05 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:31:06.530005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:06.531091 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:06.538260 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:06.538718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:06.539526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:06.539965 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:06.700494 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:06.709093 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54115e4c-f912-4cdd-9a21-f5594c74b73e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.184549 Nov 23 10:31:06.710274 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 631/1270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:06 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:07.731905 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:07.732530 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:07.740004 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:07.740532 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:07.741361 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:07.741894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:07.912263 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:07.920179 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73e35e6c-af9c-473a-a726-7f07dc890eb1 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.191998 Nov 23 10:31:07.920933 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 640/1271] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:07 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:08.940978 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:08.942127 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:08.949070 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:08.949533 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:08.950370 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:08.950818 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:09.104640 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:09.112478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-396e033d-ca21-4cb5-9ce7-719befed4a3b tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.175381 Nov 23 10:31:09.113073 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 632/1272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:08 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:10.140577 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:10.142006 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:10.155302 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:10.155893 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:10.156953 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:10.157461 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:10.364827 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:10.379942 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a8388d8-5436-490f-98d7-5aa2b81644b9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.245387 Nov 23 10:31:10.381048 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 641/1273] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:10 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:11.405903 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:11.406549 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:11.414255 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:11.414718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:11.415545 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:11.415982 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:11.617531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:11.625988 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5a62862-45d3-48b5-8491-cdc97c11ea4c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.224203 Nov 23 10:31:11.632684 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 633/1274] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:11 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 10:31:12.441309 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-9a05116d-ad4d-4b46-88d3-c79d49e4d459 req-6461d043-3447-433f-bd05-63c3e0b034a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979672b7-eccf-4cdb-aafe-f47d67e67f6d", "name": "network-vif-plugged", "status": "completed", "tag": "085d65fc-9807-4a7c-8f2a-67394f36862b"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:31:12.444642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:31:12.444642 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 23 10:31:12.460246 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9a05116d-ad4d-4b46-88d3-c79d49e4d459 req-6461d043-3447-433f-bd05-63c3e0b034a1 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:12.461273 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-9a05116d-ad4d-4b46-88d3-c79d49e4d459 req-6461d043-3447-433f-bd05-63c3e0b034a1 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:12.491227 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-9a05116d-ad4d-4b46-88d3-c79d49e4d459 req-6461d043-3447-433f-bd05-63c3e0b034a1 service nova] Creating event network-vif-plugged:085d65fc-9807-4a7c-8f2a-67394f36862b for instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d on hv-cinder-80403 Nov 23 10:31:12.502185 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-9a05116d-ad4d-4b46-88d3-c79d49e4d459 req-6461d043-3447-433f-bd05-63c3e0b034a1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067966 Nov 23 10:31:12.503367 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 642/1275] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:31:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:31:12.654391 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:12.655307 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:12.663388 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:12.664041 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:12.665324 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:12.665820 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:12.920768 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:12.931372 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-699ad73a-883d-439c-b7e5-e6b457bfd1eb tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.282584 Nov 23 10:31:12.932385 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 634/1276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:12 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:13.955894 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:13.957065 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:13.968533 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:13.969348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:13.970824 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:13.971621 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:14.184129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:14.193587 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c028cd56-3556-4958-81a6-18afb484f440 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1263 microversion: 2.1 time: 0.245143 Nov 23 10:31:14.194355 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 643/1277] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:13 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1263 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:15.212397 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:15.213003 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:15.219431 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:15.220214 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:15.221587 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:15.222410 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:15.381845 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:15.390207 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bcf6c617-efc2-466c-bf67-fa650718a7f9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1450 microversion: 2.1 time: 0.181356 Nov 23 10:31:15.390919 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 635/1278] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:15 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:15.407633 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:31:15.408348 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:31:15.415575 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:15.416068 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:15.416888 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:15.417354 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:15.572464 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:31:15.580556 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55bba670-ebcb-4311-b3a2-ba837d2c1e47 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1450 microversion: 2.1 time: 0.176830 Nov 23 10:31:15.581138 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 644/1279] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:31:15 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:31:17.740814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-892f817f-c1ee-491a-bc8d-5955a401c9de req-b7fa2c84-c54c-4c97-9dae-9bf5b1fce0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979672b7-eccf-4cdb-aafe-f47d67e67f6d", "tag": "085d65fc-9807-4a7c-8f2a-67394f36862b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:31:17.740814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:31:17.740814 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:31:17.748756 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-892f817f-c1ee-491a-bc8d-5955a401c9de req-b7fa2c84-c54c-4c97-9dae-9bf5b1fce0c9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:31:17.749194 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-892f817f-c1ee-491a-bc8d-5955a401c9de req-b7fa2c84-c54c-4c97-9dae-9bf5b1fce0c9 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:31:17.761486 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-892f817f-c1ee-491a-bc8d-5955a401c9de req-b7fa2c84-c54c-4c97-9dae-9bf5b1fce0c9 service nova] Creating event network-changed:085d65fc-9807-4a7c-8f2a-67394f36862b for instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d on hv-cinder-80403 Nov 23 10:31:17.769440 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-892f817f-c1ee-491a-bc8d-5955a401c9de req-b7fa2c84-c54c-4c97-9dae-9bf5b1fce0c9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033422 Nov 23 10:31:17.771110 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 636/1280] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:31:26.898176 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:31:26.898788 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:31:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:32:47.970584 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:47.971324 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:47.972742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-8725f196-6fc3-4ac2-85f6-d31e461e4eb3 req-4f733e72-1c29-49a4-b9f7-8242fd655de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979672b7-eccf-4cdb-aafe-f47d67e67f6d", "tag": "085d65fc-9807-4a7c-8f2a-67394f36862b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:32:47.974021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:32:47.974021 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:32:47.978260 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:47.978708 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:47.979505 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:47.979937 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:47.982158 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8725f196-6fc3-4ac2-85f6-d31e461e4eb3 req-4f733e72-1c29-49a4-b9f7-8242fd655de3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:47.982601 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-8725f196-6fc3-4ac2-85f6-d31e461e4eb3 req-4f733e72-1c29-49a4-b9f7-8242fd655de3 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:47.994315 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-8725f196-6fc3-4ac2-85f6-d31e461e4eb3 req-4f733e72-1c29-49a4-b9f7-8242fd655de3 service nova] Creating event network-changed:085d65fc-9807-4a7c-8f2a-67394f36862b for instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d on hv-cinder-80403 Nov 23 10:32:48.000071 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-8725f196-6fc3-4ac2-85f6-d31e461e4eb3 req-4f733e72-1c29-49a4-b9f7-8242fd655de3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032355 Nov 23 10:32:48.003323 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 637/1281] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 10:32:48.006869 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:32:48.105160 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8380f4ee-983b-4638-a76c-fa8cecea910a tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 204 len: 0 microversion: 2.1 time: 0.140295 Nov 23 10:32:48.109167 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 645/1282] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:32:47 2021] DELETE /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:32:48.118162 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:48.119952 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:48.129987 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:48.131278 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:48.133139 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:48.134254 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:48.396462 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:48.411852 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-79f3f628-5ae3-4525-9498-3fd4ad7dce17 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1575 microversion: 2.1 time: 0.300323 Nov 23 10:32:48.413145 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 638/1283] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:48 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:49.432038 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:49.432738 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:49.439504 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:49.439946 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:49.440732 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:49.441163 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:49.590305 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:49.597686 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70782b97-e19e-4fb9-bf93-af59b0703a25 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1456 microversion: 2.1 time: 0.170532 Nov 23 10:32:49.598285 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 646/1284] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:49 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1456 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:50.468130 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-934e2c6b-67dc-4cfa-926c-74e7db93af3a req-a2789295-b0b4-4567-a4a1-ee88ee7204b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979672b7-eccf-4cdb-aafe-f47d67e67f6d", "name": "network-vif-deleted", "tag": "085d65fc-9807-4a7c-8f2a-67394f36862b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:32:50.469929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:32:50.469929 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:32:50.483032 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-934e2c6b-67dc-4cfa-926c-74e7db93af3a req-a2789295-b0b4-4567-a4a1-ee88ee7204b2 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:50.483463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-934e2c6b-67dc-4cfa-926c-74e7db93af3a req-a2789295-b0b4-4567-a4a1-ee88ee7204b2 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:50.510132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-934e2c6b-67dc-4cfa-926c-74e7db93af3a req-a2789295-b0b4-4567-a4a1-ee88ee7204b2 service nova] Creating event network-vif-deleted:085d65fc-9807-4a7c-8f2a-67394f36862b for instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d on hv-cinder-80403 Nov 23 10:32:50.518544 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-934e2c6b-67dc-4cfa-926c-74e7db93af3a req-a2789295-b0b4-4567-a4a1-ee88ee7204b2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053743 Nov 23 10:32:50.519677 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 639/1285] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:32:50.615389 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:50.616003 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:50.623020 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:50.623414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:50.624199 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:50.624636 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:50.684252 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:50.692056 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17a4b904-d571-4a7f-a5ed-e490c99db5cf tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 200 len: 1224 microversion: 2.1 time: 0.080275 Nov 23 10:32:50.692932 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 647/1286] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:50 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:51.711953 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:51.712702 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 979672b7-eccf-4cdb-aafe-f47d67e67f6d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:51.720478 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:51.720972 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:51.721886 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:51.722416 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:51.738128 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] HTTP exception thrown: Instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d could not be found. Nov 23 10:32:51.738723 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Returning 404 to user: Instance 979672b7-eccf-4cdb-aafe-f47d67e67f6d could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:32:51.739574 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9e7e6f4-205c-4cdb-82f3-667db96319c6 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d" status: 404 len: 111 microversion: 2.1 time: 0.032251 Nov 23 10:32:51.740223 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 640/1287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:51 2021] GET /compute/v2.1/servers/979672b7-eccf-4cdb-aafe-f47d67e67f6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:32:54.883991 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:54.884624 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:54.885132 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5af80402-466a-4b6a-af5f-491ee311c638 req-d649f5f6-f83c-4631-a0be-0d6d233c7706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723738a5-b749-4d60-b025-d5afb7e6df8a", "tag": "9a9144fd-1d47-480f-8c17-62ee6f71529b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:32:54.886746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:32:54.886746 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:32:54.893522 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:54.894247 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:54.895366 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:54.895861 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5af80402-466a-4b6a-af5f-491ee311c638 req-d649f5f6-f83c-4631-a0be-0d6d233c7706 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:54.895994 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:54.896426 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5af80402-466a-4b6a-af5f-491ee311c638 req-d649f5f6-f83c-4631-a0be-0d6d233c7706 service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:54.910179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5af80402-466a-4b6a-af5f-491ee311c638 req-d649f5f6-f83c-4631-a0be-0d6d233c7706 service nova] Creating event network-changed:9a9144fd-1d47-480f-8c17-62ee6f71529b for instance 723738a5-b749-4d60-b025-d5afb7e6df8a on hv-cinder-80403 Nov 23 10:32:54.916404 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5af80402-466a-4b6a-af5f-491ee311c638 req-d649f5f6-f83c-4631-a0be-0d6d233c7706 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035397 Nov 23 10:32:54.917341 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 641/1288] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:32:54.926140 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 10:32:55.012082 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d545216-06d9-4810-9dc8-5fde336c7c22 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 204 len: 0 microversion: 2.1 time: 0.132851 Nov 23 10:32:55.012725 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 648/1289] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:32:54 2021] DELETE /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 10:32:55.021531 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:55.023238 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:55.030628 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:55.033273 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:55.034620 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:55.035131 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:55.307437 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:55.320950 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67691491-6662-491d-ad9d-56796a03a272 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1575 microversion: 2.1 time: 0.302254 Nov 23 10:32:55.322052 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 642/1290] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:55 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:56.339622 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:56.340385 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:56.346657 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:56.347102 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:56.347865 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:56.348298 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:56.420356 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:32:56.420947 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: Tue Nov 23 10:32:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:32:56.492204 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:56.500215 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fc0014a-20aa-45a0-94d2-c5166f31d005 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1456 microversion: 2.1 time: 0.165125 Nov 23 10:32:56.500796 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 649/1291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:56 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1456 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:57.349718 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-21acf8f5-55cf-4571-858f-67b87bf031eb req-dd06d3e9-7f5f-4f0a-82c7-214dbc94cb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723738a5-b749-4d60-b025-d5afb7e6df8a", "name": "network-vif-deleted", "tag": "9a9144fd-1d47-480f-8c17-62ee6f71529b"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 10:32:57.352694 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 10:32:57.352694 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Nov 23 10:32:57.364263 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-21acf8f5-55cf-4571-858f-67b87bf031eb req-dd06d3e9-7f5f-4f0a-82c7-214dbc94cb7d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:57.364857 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-21acf8f5-55cf-4571-858f-67b87bf031eb req-dd06d3e9-7f5f-4f0a-82c7-214dbc94cb7d service nova] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:57.378181 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-21acf8f5-55cf-4571-858f-67b87bf031eb req-dd06d3e9-7f5f-4f0a-82c7-214dbc94cb7d service nova] Creating event network-vif-deleted:9a9144fd-1d47-480f-8c17-62ee6f71529b for instance 723738a5-b749-4d60-b025-d5afb7e6df8a on hv-cinder-80403 Nov 23 10:32:57.384256 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-21acf8f5-55cf-4571-858f-67b87bf031eb req-dd06d3e9-7f5f-4f0a-82c7-214dbc94cb7d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040836 Nov 23 10:32:57.385179 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 643/1292] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Nov 23 10:32:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 10:32:57.518258 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:57.518846 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:57.525272 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:57.525943 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:57.526733 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:57.527167 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:57.599960 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503a487ef2034c848bf728d634073470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5464f3828b40d9bda83c9806c746b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 10:32:57.611458 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a4a4dc47-ed50-4eb2-8660-3abab6890e2c tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 200 len: 1224 microversion: 2.1 time: 0.096844 Nov 23 10:32:57.612441 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 650/1293] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:57 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 10:32:58.634790 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:58.635492 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: 723738a5-b749-4d60-b025-d5afb7e6df8a] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:58.642005 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:58.642463 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:58.643245 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:58.643686 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:58.657533 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] HTTP exception thrown: Instance 723738a5-b749-4d60-b025-d5afb7e6df8a could not be found. Nov 23 10:32:58.658154 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Returning 404 to user: Instance 723738a5-b749-4d60-b025-d5afb7e6df8a could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:32:58.658986 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-23179f10-8d1b-4bda-8ba6-703858eac20e tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a" status: 404 len: 111 microversion: 2.1 time: 0.028907 Nov 23 10:32:58.659526 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 644/1294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:58 2021] GET /compute/v2.1/servers/723738a5-b749-4d60-b025-d5afb7e6df8a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:32:59.111368 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:59.113607 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:59.118765 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:59.119208 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:59.119979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:59.120413 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:59.133610 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] HTTP exception thrown: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. Nov 23 10:32:59.134225 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Returning 404 to user: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:32:59.135691 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3348c1d-fbff-4f3c-a7f6-07cf57556e3f tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 404 len: 111 microversion: 2.1 time: 0.028142 Nov 23 10:32:59.136250 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 651/1295] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Nov 23 10:32:59 2021] DELETE /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:32:59.144292 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:32:59.144907 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] [instance: ca4231d3-1794-4304-8ccc-76b478815c0f] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 10:32:59.151039 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:59.151491 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:59.152267 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 10:32:59.152820 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Lock "2e6ac9ba-2256-4cf3-842a-33e03ff00bfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 10:32:59.167301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] HTTP exception thrown: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. Nov 23 10:32:59.167918 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Returning 404 to user: Instance ca4231d3-1794-4304-8ccc-76b478815c0f could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 10:32:59.168742 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4174713b-c2ec-451a-a257-d92e963ac851 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f" status: 404 len: 111 microversion: 2.1 time: 0.028254 Nov 23 10:32:59.169289 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 645/1296] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Nov 23 10:32:59 2021] GET /compute/v2.1/servers/ca4231d3-1794-4304-8ccc-76b478815c0f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 10:33:00.455979 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd5fab04-d4cc-4d69-ab40-b0d7088ebff9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] Calling method '.version_select at 0x7f9fd75c08b0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 10:33:00.482379 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd5fab04-d4cc-4d69-ab40-b0d7088ebff9 tempest-TestVolumeBootPattern-150463677 tempest-TestVolumeBootPattern-150463677-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-279048301" status: 202 len: 0 microversion: 2.1 time: 0.030043 Nov 23 10:33:00.487129 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 652/1297] 10.222.0.41 () {58 vars in 1259 bytes} [Tue Nov 23 10:33:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-279048301 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 10:34:31.878898 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:34:31.879638 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:34:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:36:10.935675 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:36:10.936305 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: Tue Nov 23 10:36:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:36:16.439556 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:36:16.440301 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: Tue Nov 23 10:36:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:37:51.896741 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:37:51.897414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:37:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:38:03.045928 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:38:03.046603 dv-cinder-804035-15-iscsi devstack@n-api.service[116104]: Tue Nov 23 10:38:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:38:06.930414 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:38:06.931017 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:38:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 10:38:19.200207 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 10:38:19.200885 dv-cinder-804035-15-iscsi devstack@n-api.service[116103]: Tue Nov 23 10:38:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!